Tracking safety conditions of an area

ABSTRACT

Apparatus for electronically quantifying conditions of a person and an environment containing the person, as well as a sequence of positions occupied by the person and a direction the person faced at those positions. Wireless communications track a series of positions over time and provide user interfaces indicating where a person has been and who the person has come within a minimum distance of. Sensors may be operative to provide ongoing evaluation of a condition of the person, such as a body temperature and heartrate which may trigger an alarm state if the body temperature rises above a specified value. Electronic sensors may also be quantify environmental conditions over time and present the conditions in the user interface.

INCORPORATION BY REFERENCE TO RELATED APPLICATIONS

The present application claims priority to Non Provisional patentapplication Ser. No. 16/935,857, filed Jul. 22, 2020 and entitledTRACKING SAFETY CONDITIONS OF AN AREA, as a continuation application.This application references the Non Provisional U.S. patent applicationSer. No. 16/935,857, filed Jul. 22, 2020 and entitled TRACKING SAFETYCONDITIONS OF AN AREA, the entire contents of which are herebyincorporated by reference. This application also references the NonProvisional U.S. patent application Ser. No. 16/504,919, filed Jul. 8,2019 and entitled METHOD AND APPARATUS FOR POSITION BASED QUERY WITHAUGMENTED REALITY HEADGEAR; and the Non Provisional patent applicationSer. No. 16/688,775, filed Nov. 19, 2019 and entitled METHOD ANDAPPARATUS FOR WIRELESS DETERMINATION OF POSITION AND ORIENTATION OF ASMART DEVICE the entire contents of which are hereby incorporated byreference. This application references the Non Provisional patentapplication Ser. No. 16/503,878, filed Jul. 5, 2019 and entitled METHODAND APPARATUS FOR ENHANCED AUTOMATED WIRELESS ORIENTEERING, the entirecontents of which are hereby incorporated by reference. This applicationreferences the Non Provisional patent application Ser. No. 16/297,383,filed Mar. 8, 2019 and entitled SYSTEM FOR CONDUCTING A SERVICE CALLWITH ORIENTEERING, the entire contents of which are hereby incorporatedby reference. This application references the Non Provisional patentapplication Ser. No. 16/249,574, filed Jan. 16, 2019 and entitledORIENTEERING SYSTEM FOR RESPONDING TO AN EMERGENCY IN A STRUCTURE, theentire contents of which are hereby incorporated by reference. Thisapplication references the Non Provisional patent application Ser. No.16/176,002, filed Oct. 31, 2018 and entitled SYSTEM FOR CONDUCTING ASERVICE CALL WITH ORIENTEERING, the entire contents of which are herebyincorporated by reference. This application references the NonProvisional patent application Ser. No. 16/171,593, filed Oct. 26, 2018and entitled SYSTEM FOR HIERARCHICAL ACTIONS BASED UPON MONITOREDBUILDING CONDITIONS, the entire contents of which are herebyincorporated by reference. This application references the NonProvisional patent application Ser. No. 16/165,517, filed Oct. 19, 2018and entitled BUILDING VITAL CONDITIONS MONITORING, the entire contentsof which are hereby incorporated by reference. This applicationreferences the Non Provisional patent application Ser. No. 16/161,823,filed Oct. 16, 2018 and entitled BUILDING MODEL WITH CAPTURE OF AS BUILTFEATURES AND EXPERIENTIAL DATA, the entire contents of which are herebyincorporated by reference. This application references the NonProvisional patent application Ser. No. 16/142,275, filed Sep. 26, 2018and entitled METHODS AND APPARATUS FOR ORIENTEERING, the entire contentsof which are hereby incorporated by reference. This applicationreferences the Non Provisional patent application Ser. No. 15/887,637,filed Feb. 2, 2018 and entitled BUILDING MODEL WITH CAPTURE OF AS BUILTFEATURES AND EXPERIENTIAL DATA, the entire contents of which are herebyincorporated by reference. This application references the NonProvisional patent application Ser. No. 15/716,133, filed Sep. 26, 2017and entitled BUILDING MODEL WITH VIRTUAL CAPTURE OF AS BUILT FEATURESAND OBJECTIVE PERFORMANCE TRACKING, the entire contents of which arehereby incorporated by reference. This application references the NonProvisional patent application Ser. No. 15/703,310, filed Sep. 13, 2017and entitled BUILDING MODEL WITH VIRTUAL CAPTURE OF AS BUILT FEATURESAND OBJECTIVE PERFORMANCE TRACKING, the entire contents of which arehereby incorporated by reference. This application references the NonProvisional patent application Ser. No. 16/528,104, filed Jul. 31, 2019and entitled SMART CONSTRUCTION WITH AUTOMATED DETECTION OF ADVERSESTRUCTURE CONDITIONS AND REMEDIATION, the entire contents of which arehereby incorporated by reference. This application references theNon-Provisional U.S. patent application Ser. No. 16/657,660, filed Oct.18, 2019 and entitled METHOD AND APPARATUS FOR CONSTRUCTION ANDOPERATION OF CONNECTED INFRASTRUCTURE, the entire contents of which arehereby incorporated by reference. This application references theNon-Provisional U.S. patent application Ser. No. 16/721,906, filed Dec.19, 2019 and entitled METHOD AND APPARATUS FOR WIRELESS DETERMINATION OFPOSITION AND ORIENTATION OF A SMART DEVICE, the entire contents of whichare hereby incorporated by reference. This application references theNon Provisional patent application Ser. No. 16/549,503, filed Aug. 23,2019 and entitled METHOD AND APPARATUS FOR AUGMENTED VIRTUAL MODELS ANDORIENTEERING, the entire contents of which are hereby incorporated byreference. This application references the Non Provisional patentapplication Ser. No. 16/775,223, filed Jan. 28, 2020 and entitledSPATIAL SELF-VERIFYING ARRAY OF NODES, the entire contents of which arehereby incorporated by reference.

FIELD OF THE INVENTION

The present invention relates to automated tracking of safety aspects aperson within a defined area. More specifically, the present inventionprovides for wirelessly tracking a position and condition of a personwithin a structure or campus. Wireless communications are used togenerate positions of a person in three dimensional space and anelectronic sensor quantifies physical conditions of the person atrespective positions and physical conditions of the environment at thosepositions. The position and conditions may be periodically determinedand recorded for multiple persons such that a controller may determinehow often, and for how long, two persons were proximate to each other(if at all) and a biometric condition of each person when in proximityto each other and following such proximity.

BACKGROUND OF THE INVENTION

It has long been recognized that it is valuable to be aware of who is ina defined area such as a building or on a job site. Typically, controlhas been at an entry point where authorized people are admitted andunauthorized people are prevented from entry. Control over who isallowed in a workplace, for example, provides peace of mind to workersand security for the company assets. Company management and workers havea level of confidence that other persons on a campus are either fellowemployees or authorized visitors.

Entry point control provides the confidence that who is on a campusbelongs on a campus. It cannot provide further control and assurancethat those on campus will only access areas related to their purpose forbeing on campus, and cannot provide feedback as to behavior during aperson's time on the campus.

In addition, in more recent times, it has become important to ascertainnot only who is within an area, such as a campus, but whether people inthe area pose a health threat to themselves or others while in the area.Even if a person appears healthy at a time of entry, there is no ongoingassessment of the person's health and no record of where a sick personhas been, which people they have been in critical contact with, andwhich equipment they may have infected.

SUMMARY OF THE INVENTION

Accordingly, the present invention combines methods and apparatus forelectronically quantifying conditions of a person and an environmentcontaining the person, as well as a sequence of positions occupied bythe person and a direction the person faced at those positions. For somecontagions, such as COVID-19, a “close contact” has been defined asanyone who was within 6 feet of an infected person for at least 15minutes starting from 48 hours before the person began feeling sickuntil the time the patient was isolated (see U.S. Center of DiseaseControl and Prevention). The present invention provides methods andapparatus to track physiological states of a person to provide empiricalquantification of what it means to “feel sick” and also quantify whereand when a sick person began to manifest conditions designated as“sick”.

The present invention additionally quantifies when a sick person was(and if they were) within a critical distance (e.g. six feet) of ahealthy person and a duration of the person being within the criticaldistance. In some embodiments, the present invention also quantifieswhether the sick person was facing the healthy person while they werewithin a defined critical distance of each other.

In another aspect, data indicates that some environmental conditions,such as high humidity and high temperatures limit the spread of suchviral contagions. The present invention can quantify environmentalconditions present during the time of the being in “close contact” (orother critical distance) access to quantified environmental conditionsmay help to determine whether a viral contagion, such as COVID 19, willspread from a sick person to the healthy person.

Data generated by the electronic quantification of conditions may beused to assess a safety risk associated with the person, as well as asafety risk for other persons in proximity to the person. For example, aperson with a body temperature quantified to be more than 100° F. may beconsidered to be running a fever and therefore to be ill. It may beimportant to be able to assess where the person with an elevated bodytemperature has been, and when they were at a location, and in whichdirection they faced (and consequently exhaled, coughed, sneezed etc.).It may also be important to determine which other persons came intoclose proximity with the ill person and for how long, and whether theother person was in front of the ill person, or back to back with them.

The present invention provides methods and apparatus for deployingelectronic sensors to quantify conditions in a defined area, includingconditions that quantify physiological states of human beings (or othermammals), In addition, the present invention provides for generating auser interface with content based upon a geospatial location of a userand a direction of interest provided by the user. Essentially, basedupon who a user is, where the user is, and which direction an areaindicated by the user is oriented, the present invention provides aninteractive user interface that combines a quantification of a conditionwithin with area indicated and digital content.

The present invention additionally provides for generation of datauseful in quantifying which conditions are most conducive to transfer ofa contagion from a sick person to a healthy person. Such data isgenerated during the normal course of operation of a facility andtracking of physiological data of persons in the facility, conditionswithin the facility and position tracking and dwell time of a firstperson within a designated distance to a second person.

Other aspects of the present invention include an augmented realityinterface that allows a user to direct a Smart Device towards an area,and have an image of the presented in a virtual environment thatcombines a rendition of the physical environment with digital contentdescriptive of persons and conditions in the environment. For example,by holding up a smart device, a user may be presented with a video typeimage showing a scene in front of the smart device and have one or morepersons in the scene identified. In addition, values for biometrics(e.g. a physiological condition such as body temperature) for the personmay be displayed. As the person moves about within the scene, a link(icon or other user interactive device) to information about the personwill follow the person in the scene on the smart device. The user needonly select the link to cause the smart device to display more detailedinformation about the person selected.

The present invention uses electronic sensors to quantify conditionspresent with the person and an environment in which the person isencompassed. Transceivers are co-located with the sensors and wirelesscommunications are used to determine a location of the person based uponthe transceiver location. Based upon values of a wireless communicationcompleted by the Node, positional coordinates are generated indicatingwhere the sensor is located. The sensor is operative to quantify acondition at a location monitored by the sensor. When a Smart Device isused to view a physical area containing the Node and the sensor, theSmart Device is operative to display a rendition of the area with theNode location and the conditions measured by the sensor.

Essentially, the present invention enables point and query (or ask andquery) access to information or other content in an area chosen via aSmart Device, including, for example content about a person wearing apositional tag and biometric sensor. The Smart Device may be used togenerate an interface indicating which people, equipment, vehicles orother items are viewable to the Smart Device and place those items intothe context of the environment surrounding the Smart Device. Theinterface will also indicate a quantification of the environment.

According to the present invention such functionality may beaccomplished by establishing a target area and determining which tagsare present within the target area. Tags may be virtual or physical.Virtual tags are associated with positional coordinates and viewablewhenever a target area is designated to encompass the coordinates thevirtual tag. Physical tags include a processor and a transceiver capableof wireless communication. Tracking of a position and content associateda physical tag may be updated in real time or on a periodic basis.Physical tags may be moved into a target area or the target area may bemoved to encompass the physical tag. The present invention willautomatically generate an interface indicating which tags are containedwithin an area portrayed by the interface, as well as which persons andsensors are associated with a tags. Additionally, the interface mayindicate where a tag is in relation to the Smart Device. The interfacemay also access digital content that has been stored and associated withthe tag and present it in the interface.

By aligning real world and virtual world content, a real world siteexperience is enriched with content from a geospatially linked virtualworld. The virtual world content is made available to an Agent basedupon a position and a direction of a Radio Target Area (“RTA”) specifiedby a Smart Device supported by the Agent. A geospatial position anddirection of interest that is contained within the RTA is generatedusing wireless communication with reference point transmitters. Wirelesscommunication capabilities of the Reference Point Transmitters determineparameters associated with a Wireless Communication Area (“WCA”). TheRTA is a subset of the WCA.

The present invention provides for methods and apparatus for executingmethods that augment a physical area, such as an area designate as awireless communication area. The method may include the steps oftransceiving a wireless communication between a Smart Device andmultiple reference point transceivers fixedly located at a positionwithin a wireless communication area; generating positional coordinatesfor the Smart Device based upon the wireless communication between theSmart Device and the multiple reference transceivers; establishing aradio target area for an energy receiving sensor; receiving energy intothe energy receiving sensor from the radio target area; generating adigital representation of the energy received into the energy receivingsensor at an instance in time; generating positional coordinates for atag at the instance in time, the tag comprising digital content andaccess rights to the digital content; determining the tag is locatedwithin the radio target area based upon the positional coordinates forthe tag; generating a user interactive interface comprising staticportions based upon the digital representation of the energy receivedinto the energy receiving sensor; generating a dynamic portion of theuser interactive interface based upon the positional coordinates for thetag and the positional coordinates for the Smart Device; receiving auser input into the dynamic portion of the user interactive interface;and based upon the user input received into the dynamic portion of theuser interactive interface, including the digital content in the userinteractive interface.

In some embodiments, multiple disparate energy levels may be receivedinto the energy receiving sensor at the instance in time, each disparateenergy level received from a different geospatial location; associatingpositional coordinates with the disparate energy levels; and indicatingthe disparate energy levels and relative positions of the disparateenergy levels in the user interactive interface. A tag may include avirtual tag with the digital content and a location identified viapositional coordinates.

In another aspect, a physical tag may include a transceiver capable ofwireless communication with the multiple reference transceivers and themethod may include transceiving a wireless communication between a tagand multiple reference point transceivers; and generating positionalcoordinates for the tag based upon the wireless communication betweenthe tag and the multiple reference transceivers. The wirelesscommunication between the Smart Device and the multiple reference pointtransceivers may be accomplished by transceiving using an Ultra-Widebandmodality; Bluetooth modality or other wireless modality, such as WiFi.

A wireless communication area may be identified as including a radiotransmission area of the energy receiving sensor and the wirelesscommunication area may be based upon a communication distance of theUltra-Wideband modality in an area encompassing the energy receivingsensor.

Transceiving a wireless communication between a tag and multiplereference point transceivers may be accomplished using w wirelessmodality such as, for example, a UWB or Bluetooth modality; andgenerating positional coordinates for the tag based upon the wirelesscommunication between the tag and the multiple reference transceiversmay be accomplished using the same modalities. Positional coordinatesmay include one or more of: Cartesian Coordinates, an angle of arrivaland an angle of departure and a distance.

In another aspect, access rights to tag content may be required andbased upon an identifier of the Smart Device or a user operating theSmart Device. A dynamic portion of the user interactive interface mayinclude an icon indicative of the digital content associated with thetag.

The details of one or more examples of the invention are set forth inthe accompanying drawings and the description below. The accompanyingdrawings that are incorporated in and constitute a part of thisspecification illustrate several examples of the invention and, togetherwith the description, serve to explain the principles of the invention:other features, objects, and advantages of the invention will beapparent from the description, drawings, and claims herein.

DESCRIPTION OF THE DRAWINGS

The accompanying drawings, that are incorporated in and constitute apart of this specification, illustrate several embodiments of theinvention and, together with the description, serve to explain theprinciples of the invention:

FIG. 1 illustrates location determination with wireless communication toreference points.

FIG. 2 illustrates a person with wearable wireless communicationtransceivers.

FIG. 2A illustrates wearable items with transceivers and sensors.

FIG. 2B illustrates a wearable item including vest type garment withtransceivers and sensors

FIG. 2C illustrates a wearable item that is torso supported withtransceivers and sensors.

FIG. 2D illustrates wearable item including footwear with transceiversand sensors.

FIG. 2E illustrates a wearable item including headgear with transceiversand sensors.

FIG. 2F illustrates a processing plant environment with persons andsensors and transceivers.

FIG. 3 illustrates methods of orienteering by device movement.

FIGS. 4A-4D illustrate exemplary configurations of antenna arrays.

FIG. 5A illustrates an exemplary Smart Device with an array of antennas.

FIG. 5B illustrates exemplary methods of indicating directions withSmart Devices and antenna arrays.

FIG. 5C illustrates an exemplary method of a user utilizing an orientedstereoscopic sensor system to orient a direction of interest.

FIG. 6 illustrates apparatus that may be used to implement aspects ofthe present disclosure including executable software.

FIG. 7 illustrates an exemplary handheld device that may be used toimplement aspects of the present disclosure including executablesoftware.

FIGS. 8A-8G illustrate aspects of the determination of directions ofinterest and Fields of View and information display.

FIGS. 9A-9C illustrate additional aspects of information display.

FIGS. 10A-10B illustrates an exemplary method for generating anaugmented-reality Radio Target Area for a Smart Device.

FIG. 11 illustrates an exemplary database structure according to theinstant specification.

FIG. 12 illustrates additional exemplary method for displaying RadioTarget Areas with Smart Devices.

FIG. 13 illustrate exemplary aspects of Wireless Communication Areas inRadio Target Area display.

FIG. 14 illustrates a set of polygons generated via LIDAR that may beused for geospatial recognition.

FIGS. 15A-15B illustrate method steps that may be implemented in someembodiments of the present invention.

FIG. 16 illustrates a block diagram of components that may be includedin some embodiments of a wearable item.

DETAILED DESCRIPTION

The present invention provides a safety system with methods andapparatus for tracking a position and orientation of person(s) within adefined area as well as physiological measurements (sometimes referredto herein as “biometrics”) of the person. The physiological measurementsmay be used to infer a relative health of the person, and whether theperson represents a health hazard to other persons that are within adistance deemed to impart adverse health conditions.

In some embodiments, a path (multiple positions at specific timeintervals) traversed by the person tracked may be recreated and comparedto positions of other persons and/or items. For example, if a firstperson, Ms. Smith is being tracked, the present invention will determineif a path Ms. Smith traveled coincided with a path traveled by Mr.Jones, and also whether Ms. Smith and Mr. Jones faced each other whilethey were within a threshold distance. A sensor may be used to quantifya physiological condition of one or both of Ms. Smith and Mr. Jones inorder to assess whether Ms. Smith posed a health risk to Mr. Jones.Health risk may include, for example, a likelihood of transferring abiological conveyor of disease (e.g. a virus and/or bacteria) from Ms.Smith to Mr. Jones.

Similarly, if Ms. Smith came within a threshold distance to an item,such as a piece of equipment or an architectural aspect of a building(such as a door), the present invention may provide an indication ofwhether the item has a significant probability of being contaminatedwith a biological conveyer of disease on its surface.

In some embodiments, a user interface is generated that determines theexistence of real world aspects, such as the presence of a person withan elevated body temperature and aligned virtual-world content, such asan icon that moves about with the person in the interface and links outto digital content associated with the person.

In the following sections, detailed descriptions of examples and methodsof the invention will be given. The description of both preferred andalternative examples though thorough are exemplary only, and it isunderstood that, to those skilled in the art, variations, modificationsand alterations may be apparent. It is therefore to be understood thatthe examples do not limit the broadness of the aspects of the underlyinginvention as defined by the claims.

In some examples, a reference point Node may be placed in a fixedlocation and function as a transceiver of signals. For example, a Nodemay receive and transmit signals in a radio frequency band of theelectromagnetic spectrum. In a simple form, a Node may receive anincoming wireless radio frequency communication and also broadcast aradio frequency wireless communication. Radio frequencies utilized forwireless communication may include those within the electromagneticspectrum radio frequencies used in UWB, Wi-Fi, and Bluetooth modalities,as well as IR, bisible and UV light as examples.

In some embodiments, a Node is operative to communicate timing data anddata generated by a sensor. Such communications may provide identifyinginformation unique to the Node, data related to the synchronization oftiming with reference point transceivers, and/or data received fromother Nodes.

A triangulation calculation of the position of a Smart Device or a Nodemay result from a system of multiple reference position Nodescommunicating timing signals to or from the Smart Device or Node.Methods of calculating positions via wireless communications may includeone or more of: RTT, RSSI, AoD, AoA, timing signal differential and thelike. Triangulation or other mathematical techniques may also beemployed in determining a location.

The process of determination of a position based upon triangulation withthe reference points may be accomplished, for example via executablesoftware interacting with a controller in a Node, a Smart Device, orserver.

Referring now to FIG. 1, components are illustrated that may be includedin a system that is capable of wireless position and orientationaccording to the present invention. Reference Point Transceivers 101-104are shown positioned within or proximate to a defined area 106. Wirelesscommunications between the Reference Point Transceivers and one or moreTransceivers 105 supported by an Agent 100 include timing data or otherinformation useful to determine a location 107 of the Transceiver 105supported by the Agent 100, within or proximate to the defined area 106.

Positions of the Reference Point Transceivers 101-104, which are fixedin respective locations 108 within or proximate to the defined area 106,define a wireless communication area (WCA) 112. Essentially the WCA 112defines an area in which a location of a person may be tracked. A sensormay continue to quantify a physiological state of the person supportingan appropriate sensor whether or not the person is within the WCA 112.

In some embodiments, data quantifying a physiological state of a personmay be stored within a Node or Tag supported by the person andtransmitted via wireless communication once a Node or Tag is withinwireless communication range of a Reference Point Transceiver 101-104.

The Reference Point Transceivers 101-104 transceive information capableof being used to determine a position of the one or more Transceivers105 supported by an Agent 100, such as, for example, a Transceiver 105in or associated with a Smart Device, headgear or Tag supported by theAgent 100. Transceiving may be conducted via one or more wirelesstransmission modalities between the Transceiver 105 supported by theAgent 100 and the Reference Point Transceivers 101-104.

By way of non-limiting example, Transceivers 105 supported by the Agent100 may be included in, and/or be in logical communication with, a SmartDevice, such as a smart phone, tablet, headgear, ring, arm band, watch,footwear, vest, lab coat, smock, wand, pointer, badge, Tag, Node orother Agent 100 supportable device with a portable Transceiver 105 ableto transceive with the Reference Point Transceivers 101-104.

The Reference Point Transceivers 101-104 may include devices capable ofwireless communication via a same modality as that utilized by theAgent-supported Transceiver 105. A radio frequency transceiver includedin one or both of the Reference Point Transceivers 101-104 and theAgent-supported Transceiver 105 may therefore transmitters and receiversoperative to communicate via wireless modalities that include, forexample: Wi-Fi, Bluetooth, Ultra-wideband (“UWB”), ultrasonic, infrared,or other communication modality capable of logical communication betweenTransceivers 101-105.

In some embodiments, a Reference Point Transceiver 101-104 may include amulti-modality transceiver, that communicates more locally via a firstmodality, such as Ultrawideband (“UWB”), Bluetooth, Wi-Fi, ANT, Zigbee,BLE, Z Wave, 6LoWPAN, Thread, Wi-Fi, Wi-Fi-ah, NFC (near fieldcommunications), Dash 7, Wireless HART or similar modality; and to agreater distance via a second modality, such as a cellular communicationmodality (e.g. 3G, 4G, 5G and the like), sub GHz modality, InternetProtocol modalities and the like which may provide access to adistributed network, such as the Internet. Other modalities are alsowithin the scope for the present invention.

Wireless communications between Transceivers 101-105 may engage inlogical communications to provide data capable of generating one or moreof: Cartesian coordinates, polar coordinates, vector values, AoA, AoD,RTT, RSS, a GPS position, or other data that may be utilized for one ormore of: locating one or both of an Agent 100; indicating a direction ofinterest; and identify a defined area 106.

A precise location may be determined via logical processes, such astriangulation; trilateration; and/or angle phase change; based upontiming values or other mechanism to generate a distance from one or moreantennas in the multiple Reference Point Transceivers 101-104 to one ormore antennas in an Agent-supported Transceiver (s) 105.

For example, a radio transmission or light transmission be measured andcompared from three Reference Point Transceivers 101-103. Measurementmay include, one more of: a timing value, a received transmissionstrength, received transmission amplitude, and received transmissionquality.

Other embodiments may include a device recognizable via image analysisvia a sensor, LiDAR, Image Capture Device, CCD device, and the likewhich may capture an image of three or more recognizable features. Imageanalysis may identify three or more of the recognizable features and asize ratio of the respective image captured recognizable features may beutilized to calculate a distance from each and thereby a position of theAgent 100. Similarly, a height designation may be made via triangulationusing the position identifiers as reference to a known height or areference height.

Transceivers 101-105 may include circuitry, antenna(s) and logic capableof transceiving in a single modality, or multiple disparate modalities.Similarly, a Reference Point Transceiver 101-104 and/or anAgent-supported Transceiver 105 may include multiple transceiverdevices, including, antennas, transmitters and receivers.

A modality, as used in conjunction with a Transceiver, transmitterand/or receiver refers to one or both of a bandwidth of wirelesscommunication and a protocol associated with a bandwidth. By way ofnon-limiting example, a modality, as used in relation to a Transceiver,transmitter and/or receiver may include: Wi-Fi; Wi-Fi RTT; Bluetooth;UWB; Ultrasonic, sonic, infrared; ANT, Zigbee, BLE, Z Wave, 6LoWPAN,Thread, Wi-Fi, Wi-Fi 33-ah, NFC (near field communications), sub-GHz,Dash 7, Wireless HART or other logical communication medium.

Triangulation generally includes determining an intersection of threedistances 109-111, each distance 109-111 calculated from a ReferencePoint Transceiver 101-104 to an Agent-supported Transceiver 105. Thepresence invention allows for a first distance 109, to be determinedbased upon a wireless communication in a first modality; and a seconddistance 110 and a third distance 111 determined based upon a wirelesscommunication in a same or different modality as the first modality. Forexample, a first distance 109 may be determined based upon a wirelesscommunication using UWB; a second distance 110 may be determined basedupon a wireless communication using Bluetooth; and a third communicationmay be determined based upon a wireless communication using ultrasoniccommunication (other combinations of same and/or different communicationmodalities are also within the scope of the present invention).

A location 107 may be determined via triangulation based upon a measureddistance from three or more position identifiers 101-103 to theAgent-supported Transceiver 105. For example, timing associated with aradio transmission or light signal may be measured and compared from thethree Reference Point Transceivers 101-103. Other embodiments mayinclude a device recognizable via image analysis and a sensor or otherImage Capture Device, such as a CCD device, may capture an image ofthree or more Reference Point Transceivers 101-104.

Additional embodiments may include image analysis of image data capturedvia a CCD included in a Smart Device to recognize the identification ofeach of three or more of Reference Point Transceivers 101-104 and a sizeratio of the respective image captured Reference Point Transceivers101-104 may be utilized to calculate a precise position. Similarly, aheight designation may be made via triangulation using the positionidentifiers as reference to a known height or a reference height. In asimilar fashion, triangulation may be utilized to determine a relativeelevation of the Smart Device as compared to a reference elevation ofthe reference points.

In some embodiments, the location 107 of the Agent-supported Transceiver105 may be ascertained via one or more of: triangulation; trilateration;and multilateration (MLT) techniques.

In some embodiments, a geospatial location based upon triangulation maybe generated based upon a controller receiving a measurement of anglesbetween the position and known points at either end of a fixed baseline.By way of non-limiting example, a point of a geospatial location may bedetermined based upon generation of a triangle with one known side andtwo known angles. Moreover, a geospatial location based uponmultilateration may be generated based on a controller receivingmeasurement of a difference in distance to two reference positions, eachreference position being associated with a known location. Wirelesssignals may be available at one or more of: periodically, withindetermined timespans and continually. The determination of thedifference in distance between two reference positions provides multiplepotential locations at the determined distance. A controller may be usedto generate a plot of potential locations. In some embodiments, thepotential determinations generally form a curve. Specific embodimentswill generate a hyperbolic curve.

The controller may be programmed to execute code to locate a relativelyexact position along a generated curve, which is used to generate ageospatial location. The multilateration system thereby receives asinput multiple measurements of distance to reference points, wherein asecond measurement taken to a second set of stations (which may includeone station of a first set of stations) is used to generate a secondcurve. A point of intersection of the first curve and the second curvemay be used to indicate a specific location.

Other methodologies within the scope of the present invention includetrilateration, which may treat the positions of the Reference PointTransceivers as vertices of one or more triangles and/or phased arrayantennas which indicate a direction of a wireless communication.

In another aspect, in some embodiments, the location of a Transceiver101-105 may be determined and/or aided in location determination viadiscernment of data based upon a physical artifact or patterns ofartifacts, such as, for example a visually discernable feature, shape orprinted aspect located within the defined area 106. Discernment of thephysical artifact may, for example, be based upon topographicalrenditions of physical aspects included in the Structure, such as thosemeasured using LIDAR, a magnetic force, image data (or a point cloudderived from image data). A pattern on a surface may convey a referencepoint by a recognizable pattern (which may be unique to the setting),Vernier or three-dimensional structure as non-limiting examples. A SmartDevice ascertaining a physical reference mark and a distance of theSmart Device to the mark may determine a relative location in space to acoordinate system of the marks.

Marks tied to a geospatial coordinate system may be utilized todetermine a relative location based upon a distance to the mark(s). Anumber of methods may be executed to determine a distance from the SmartDevice to a mark such as, for example, a sense reflection of light beams(preferably laser beams), electromagnetic beams of wavelength outside ofthe visible band such as IR, UV, Radio and the like, or sound-basedemanations. Method steps may be implemented by executing software codewith a processor.

In some examples, a Node may function as a Reference Point Transceiver101-104. For example, a Node may receive and transmit signals in a radiofrequency band of the electromagnetic spectrum. In a simple form, a Nodemay detect an incoming signal and coincidently broadcast a radiofrequency wireless communication. Frequencies utilized for wirelesscommunication may include those within the electromagnetic spectrumradio frequencies used in UWB, Wi-Fi, and Bluetooth modalities, as wellas IR, Visible and UV light as examples.

In some embodiments, sound emanations may also be used as acommunication mechanism between a smart device and a Reference PointTransceiver 101-104. In some examples, the Reference Point Transceiver101-104 may function to communicate data with their electromagnetic orsonic transmissions. Such communications may provide identifyinginformation unique to the Node, data related to the synchronization oftiming at different well located reference points, and may also functionas general data communication nodes. A triangulation calculation of theposition of a Smart Device or a Node may result from a system ofmultiple reference position Nodes communicating timing signals to orfrom the Smart Device or Node. Methods of calculating positions viawireless communications may include one or more of: RTT, RSSI, AoD, AoA,timing signal differential and the like, Triangulation or othermathematical techniques may also be employed in determining a location.

The process of determination of a position based upon triangulation withthe reference points may be accomplished, for example via executablesoftware interacting with the controller, such as, for example viarunning an app on the Smart Device or executing software on a server.

In some embodiments, reference points may be individually identified viaidentifiers, such as a UUID (Universally Unique Identifier), or otheridentification vehicle.

Reference Position Transceivers 101-104 may be deployed in a wirelessdefined area 106, such as an interior to a building or other structureor infrastructure, to determine a location 107 of an Agent 100 within orproximate to the wireless defined area 106.

In some embodiments, Reference Position Transceivers 101-104 aregenerally fixed in a location within the wireless defined area 106. Inother embodiments, the Reference Point Transceivers 101-104 may changelocations, in these embodiments, a position of the Agent-supportedTransceiver 105 will be determined relative to the Reference PointTransceivers 101-104, but not necessarily to structure in which theReference Point Transceivers 101-104 and Agent-supported Transceiver 105are located.

The Reference Point Transceivers 101-104 and the Agent-supportedTransceiver 105 will transceive in a manner suitable for a triangulationdetermination of a location 107 of the Agent 100. Transceiving may occurvia wireless transmission to one or more Agent-supported Transceiver105. By way of non-limiting example, Agent-supported Transceiver 105 maybe included in, or be in logical communication with, a Smart Devicesupported by the Agent 100 and be able to transceive with the ReferencePosition Transceivers 101-104.

The Reference Position Transceivers 101-104 may include devices such asa radio transmitter, radio receiver, a light generator, or animage-recognizable device (i.e., an apparatus set out in a distinctivepattern recognizable by a sensor). A radio transmitter may include a UWBNode, Wi-Fi, Bluetooth or other wireless communication transceiver forentering into logical communication between Transceivers 101-105. Insome embodiments, Reference Point Transceivers 101-104 may include aWi-Fi router, UWB router or other multi-modality device thatadditionally provides access to a distributed network, such as theInternet.

Cartesian coordinates (including Cartesian coordinates generatedrelative to a GPS or other reference point), or any other coordinatesystem, may be used as data that may be utilized for one or more of:locating one or both of an Agent 100; indicating a direction ofinterest; and identifying a defined area 106. A radio transmitter mayinclude a router or other Wi-Fi device. The radio transmitter mayinclude transmissions via a Ultra-Wideband (“UWB”) frequenciesincluding, for example, frequencies above 500 MHz, 3.5-6.5 GHz or otherfrequencies usable with a UWB modality; on Wi-Fi frequencies (300 MHz-60GHz), sub GHz frequencies or other modality. A light generator maydistribute light at human-safe intensities and at virtually anyfrequency known in the art. Such frequencies may include, withoutlimitation: infrared, ultraviolet, visible, or nonvisible light.Further, a light beacon may comprise a laser, which may transmit lightat any of the aforementioned frequencies in a coherent beam.

This plurality of modalities allows for increased accuracy because eachmodality may have a different degree of reliability. For example, aSmart Device and/or Smart Receptacle may measure a timing signaltransmitted by a Reference Point Transceiver 101-104 within a differenterror tolerance than it may measure the receipt into a photodetector ofinfrared laser light.

In another, aspect, multiple timing signals that have been wirelesslycommunicated may be mathematically processed to increase an overallaccuracy, such as, for example, combined into a weighted average,average, mean, weighted mean. In situations with multiple timing signalscommunicated via different modalities a weighted average may bedetermined to be most beneficial. In some embodiments, conditions in anenvironment through which the wireless communication of values forvariables enabling determination of a location of a Transceiver 105 maybe quantified by sensors and the quantified conditions may be used tofurther ascertain a beneficial mathematical process. For example, ifsensors indicate significant electrical interference in a particularbandwidth of the electromagnetic spectrum, such as a spectrum utilizedby UWB and/or Bluetooth modalities, a mathematical process may give ahigher weight to a value (for a variable useful in determining theposition of a Transceiver 105) transmitted via an infrared modalitywhich is not effected by the electrical interference. Likewise, if asensor reading quantifies a significant amount of particulate or otherinterference in an atmosphere through which a wireless communication istransmitted, a lower mathematical weight may be allocated to an infraredtransmission (or other light beam effected by particulate) value.

Also, processing may allow for outliers of values for variables usefulin determining a location to be shed. For example, if a standardlocation calculation comprises a weighted average of multiple values forvariable useful for determining a location, which may include valuesgenerated based upon wireless communication using multiple modalities,but a particular modality yields a location greater than two standarddeviations from an average computed location, then that modality may notbe considered a recalculation and/or in future weighted locationcalculations. Similarly, values generated using a single modality thatfall outside a designated deviation (e.g. two standard deviations orthree standard deviations) may be excluded from a value generated viamathematical processing (e.g. average, weighted average, mean, median,mode, etc.).

Additionally, the radio transmitters, receivers, and/or transceivers ina Tag, Node and/or Smart Device may include multiple antennas thattransmit and/or receive electromagnetic transmissions. In someembodiments, the multiple antennas may transmit and/or receive in astaggered fashion suitable to reduce noise.

By way of non-limiting example, if a Tag, Node and/or Smart Device usesthree antennas that are operative to transmit a signal in intervals of20 milliseconds from a same or disparate selection of antenna(s). Adetected time of arrival at a receiving antenna may be used to determinea distance between a transmitting transceiver and a receiving antenna.In some embodiments, various antennas may be of varying lengths tobetter accommodate chosen wavelengths or wireless communication.

A precise location may be determined based upon wireless transmissionsbetween Nodes, such as between an Agent-supported Transceiver 105 andone or more Reference Point Transceivers 101-104. Timingdeterminations—as well as signal qualities like angle of arrival, angleof departure, transmission strength, transmission noise, andtransmission interruptions—may be considered in generating relativepositions of the Tag.

Additional considerations may include AI and unstructured queries oftransmissions between Tags and triangulation logic based upon a measureddistance from three or more Reference Point Transceivers 101-104. Forexample, a radio transmission or light emission may be measured, andtiming associated with the radio transmission or light emission todetermine a distance between disparate transceivers included in Tags,Nodes, Smart Devices and the like. Distances from three Reference PointTransceivers 101-103 may be used to generate a position of a Transceiverin consideration. Other methodologies include determination of adistance from one or more Transceiver and a respective angle of arrivaland/or angle of departure of a radio or light transmission between theNode in consideration and another Transceiver (Reference PointTransceiver or dynamic position Transceiver, e.g. an Agent supported Tagor Node).

In some embodiments of the present invention, position determination ina Structure or on a Property contemplates determination of a geospatiallocation using triangulation, trilateration, or multilaterationtechniques. A geospatial location relative to one or more knownreference points is generated based upon wireless communications betweenmultiple Transceivers 101-105. The geospatial location in space may bereferred to as having a position described with coordinates. Variouscoordinates may include Cartesian Coordinates, Polar Coordinates,Cylindrical Coordinates and the like. Cartesian Coordinates include anX,Y position indicating a planar designation (e.g. a position on a flatfloor), and a Z position (e.g. a level within a Structure, such as asecond floor). The coordinates may be generated based upon indicators ofdistance from reference points. Indicators of distance may include acomparison of timing signals received from wireless references. Ageospatial location may be generated relative to the reference points.In some embodiments, a geospatial location with reference to a largergeographic area is associated with the reference points, however, inmany embodiments, a controller will generate a geospatial locationrelative to the reference point(s) and it is not relevant where theposition is located in relation to a greater geospatial area. Inaddition to these Cartesian coordinates, polar coordinates may be used,as further described below.

A geospatial location based upon triangulation may be generated basedupon a controller receiving a measurement of angles between the positionand known points at either end of a fixed baseline. A point of ageospatial location may be determined based upon generation of atriangle with one known side and two known angles.

Referring now again to FIG. 1, triangulation essentially includesdetermining an intersection of three distances 109-111, each distance109-111 calculated from a Reference Point Transceivers 101-104 to anAgent-supported Transceiver 105. The present invention allows for afirst distance 109 to be determined based upon a wireless communicationin a first modality; and a second distance 110 and a third distance 111determined based upon a wireless communication in a same or differentmodality as the first modality. For example, a first distance 109 may bedetermined based upon a wireless communication using UWB; a seconddistance 110 may be determined based upon a wireless communication usingBluetooth; and a third communication may be determined based upon awireless communication using ultrasonic communication (othercombinations of same and/or different communication modalities are alsowithin the scope of the present invention).

A geospatial location based upon trilateration may be generated with acontroller receiving indicators of distance based upon wirelesscommunication of values for variables, such as timing values, that maybe processed to ascertain geometry of shapes, such as circles, spheres,triangles and the like.

Similarly, a geospatial location based upon multilateration may begenerated based on a controller receiving a measurement of a differencein distance to two reference positions, each reference position beingassociated with a known location. Wireless signals may be available atone or more of: periodically, within determined timespans, andcontinually. The determination of the difference in distance between tworeference positions provides multiple potential locations at thedetermined distance. A controller (such as one in the Smart Device) maybe used to generate a plot of potential locations. In some embodiments,the potential determinations generally form a curve. Specificembodiments will generate a hyperbolic curve.

The controller may be programmed to execute code to locate an exactposition along a generated curve, which is used to generate a geospatiallocation. The multilateration thereby receives as input multiplemeasurements of distance to reference points, wherein a secondmeasurement taken to a second set of stations (which may include onestation of a first set of stations) is used to generate a second curve.A point of intersection of the first curve and the second curve is usedto indicate a specific location.

In exemplary embodiments, as described herein, the distances may betriangulated based on measurements of UWB, Wi-Fi or sub GHz strength attwo points. Transceiver signals propagate outward as a wave, ideallyaccording to an inverse square law. Ultimately, a crucial feature of thepresent invention relies on measuring relative distances between twopoints. In light of the speed of Wi-Fi waves and the real-timecomputations involved in orienteering; these computations need to be ascomputationally simple as possible. Thus, depending upon a specificapplication and mechanism for quantifying a condition or location, suchas a measurement, various coordinate systems may be desirable. Inparticular, if the Smart Device moves only in a planar direction whilethe elevation is constant, or only at an angle relative to the ground,the computation less complicated.

One exemplary coordinate system includes a polar coordinate system. Oneexample of a three-dimensional polar coordinate system is a sphericalcoordinate system. A spherical coordinate system typically comprisesthree coordinates: a radial coordinate, a polar angle, and an azimuthalangle (r, θ, and φ, respectively, though θ and φ are occasionallyswapped conventionally).

By way of non-limiting example, suppose Point 1 is considered the originfor a spherical coordinate system (i.e., the point (0, 0, 0)). EachTransceiver 101-105 emitter e₁, e₂, e₃ can be described as points (r₁,θ₁, φ₁), (r₂, θ₂, φ₂), and (r₃, θ₃, φ₃), respectively. Each of ther_(i)'s (1≤i≤3) represent the distance between the Transceiver 101-105emitter and the Transceiver 101-105 receiver on the Smart Device 101 orSmart Receptacle (see FIG. 5A).

It is understood that in some embodiments, an azimuth may include anangle, such as a horizontal angle determined in an arcuate manner from areference plane or other base direction line, such as an angle formedbetween a reference point or reference direction; and line (ray orvector) such as a ray or vector generated from or continuing to a SmartDevice. In preferred embodiments, the ray or vector may be generallydirected from a Reference Position Transceiver towards, and/or intersectone or more of: an item of interest; a point of interest; anarchitectural aspect (such as a wall, beam, header, corner, arch,doorway, window, etc.); an installed component that may act as areference in an augmented virtual model (AVM) (such as, for example, anelectrical outlet, a light fixture, a plumbing fixture, an architecturalaspect; an item of equipment; an appliance; a multimedia device, etc.);another Reference Position Transceiver or other identifiabledestination.

Accordingly, in some embodiments, a spherical coordinate system mayinclude Reference Position Transceiver that is capable of determining anangle of departure of a location signal and a Transceiver that iscapable of determining an angle of arrival of the location signal; oneor both of which may be used to facilitate determination of anapplicable azimuth.

According to various embodiments of the present invention, one or bothof an angle of departure and an angle of arrival may therefore beregistered by a Transceiver that is transmitting and/or receivingwireless signals (e.g. radio frequency, UWB, Bluetooth 5.1, sonicfrequency, or light frequency).

In some embodiments, locating an Agent 100 occurs in or proximate to aStructure in which Reference Position Transceivers, (including, forexample, one or more of: Wi-Fi Transceivers, UWB Transceivers, BluetoothTransceivers, infrared Transceivers and ultrasonic Transceivers) may belocated above and/or below an Agent 100. In these embodiments, acylindrical coordinate system may be more appropriate. A cylindricalcoordinate system typically comprises three coordinates: a radialcoordinate, an angular coordinate, and an elevation (r, θ, and z,respectively). A cylindrical coordinate system may be desirable where,for example, all Wi-Fi emitters have the same elevation. Angles may bedetermined as described above.

In some embodiments, Transceivers 101-105 including arrays of antennasmay be used to measure an angle of radio communication (e.g. angle ofarrival and/or angle of departure). Various configurations oftransmitting antennas and receiving antennas may be used. For example, aradio transmission may be transmitted with a single antenna and receivedwith a receiver with an array of antennas, the phase or timingdifference of arriving signals can be used to calculate the angle atwhich the signals emerged. In angle of departure schemes, a transmittermay contain an array of antennas and may send a pattern of signalsthrough the array that arrive at a receiver with a single antenna wherethe angle of departure (AoD) is communicated.

Measurement of angle of arrival may be performed as mentioned bycalculation of time difference of arrival at the antennas in an array oralternatively can be performed by rotation of antenna elements.

Some modalities, such as those modalities that adhere to the Bluetooth5.1 or BLE5.1 standards, allow a Smart Device 101, Smart Receptacle orother Node to determine an angle of arrival (AoA) or an angle ofdeparture (AoD) for a wireless transmission. An array of antennas may beused to measure aspects of the Bluetooth signaling that may be useful tocalculate these AoA and AoD parameters. By calibrating an antennasystem, the system may be used to determine angles in one or twodimensions depending on the design of the antenna. The result may besignificant improvement in pinpointing the location of origin of asignal.

An array of antennas may be positioned relative to each other and atransmitting transceiver to allow for extraction of an AoA/AoD. Such anarray may include a rectangular array; a polar or circular array; alinear array; and a patterned array, where a number of antennas aredeployed in a pattern conducive to a particular environment fortransceiving. Antennas may be separated by characterized distances fromeach other, and in some examples, a training protocol for the antennaarray results in antenna positioning incorporating superior angle andlocation precision. Some transceivers may transceive in 2.4-2.482 GHzfrequency bands, and thus the radiofrequency transmissions may havewavelengths in the roughly 125 mm length scale. A collection of antennasseparated by significantly less than the wavelength may function bycomparing a phase of RF transmissions arriving at the antennas. Anaccurate extraction of phase differences can yield a difference in pathlength that, when accumulated, can lead to a solution for the anglesinvolved. In some embodiments, Transceivers 101-105 may include antennaarrays combined with batteries and circuitry to form completeself-contained devices. Antenna arrays and methods of using the same fordetermining position and direction of a Smart Device or other Node aredescribed in U.S. Ser. No. 16/775,223, the contents of which areincorporated herein by reference.

In an example, an Agent-supported Transceiver 105 may be located at aposition and may transmit a signal of the various types as have beendescribed. Nodes, such as Reference Point Transceivers 101-104 locatedat reference points in the wireless communication area around theposition of the Agent 100 may receive the transmission and determine theangle of arrival of that transmission. Similarly, transmissionassociated with other transceivers 101-103 may also determine an angleof arrival of transmissions. In some embodiments, transceiver 101-103may communicate with one or more of: each other, a smart device, acontroller or other processor to mathematically process multiple anglesand locations of the transceivers and calculate a position of atransmission emanation. In examples where calculations are not performedat a smart device, a communication to the smart device of the calculatedposition may be communicated.

In certain embodiments of the invention, a direction of interestindicated by Smart Device 101 or a Smart Receptacle (see FIG. 5A 502)may be determined based upon a movement of Smart Device 101 or a SmartReceptacle 502. For example, a device with a controller and anaccelerometer, such as mobile Smart Device, may include a user displaythat allows a direction to be indicated by movement of the device from adetermined location acting as a base position towards an As Builtfeature in an extended position. In some implementations, the SmartDevice may first determine a first position based upon triangulationwith the reference points and a second position (extended position) alsobased upon triangulation with the reference points. These positiondeterminations may proceed as described above.

The process of determination of a position based upon triangulation withthe reference points may be accomplished, for example via executablesoftware executed by the controller in the Smart Device, such as, forexample via running an app on the Smart Device. Logical communicationsrelevant to location determination may include, for example, one or moreof: timing signals; SIM information; received signal strength; GPS data;raw radio measurements; Cell-ID; round trip time of a signal; phase; andangle of received/transmitted signal; time of arrival of a signal; atime difference of arrival; and other data useful in determining alocation.

In another aspect, captured data may be compared to a library of storeddata using image recognition software to ascertain and/or affirm aspecific location, elevation and direction of an image capture locationand proper alignment with the virtual model.

In an exemplary embodiment, a position of a user may be determined byany of the means described herein. A user may position a sensor of anassociated smart device to be pointing in a direction of interest andobtain an image. The image may be passed on to a server with access todatabase of images containing stored images of the space around theuser. Algorithms on the server may compare the stored images to theimage captured by the user, and may calculate adjustments to thecomparative image based on where the reference image was taken inrelationship to the location of the user. Based on the determinationthat the calculated adjusted image compared to the image obtained by theuser in the direction of interest, a direction may be inferred withknown location of objects in the reference image. In some variations,the differences in features of the user obtained image compared to areference image may be used to calculate a direction of interest basedupon a location at which the reference image was obtained.

In some examples, stored images may be obtained at multiple angles toimprove accuracy of orienteering. These examples may include sensorarrays, audio capture arrays and sensor arrays with multiple datacollection angles. In some examples a full 360-degree sensor perspectivemay be obtained by such arrays. In some directional arrays, a Sensorarray (including image capture sensors) may include at least 120 degreesof data capture. By collecting such image collections as theSensor/Sensor systems are moved, a database of image perspectives may beformed and utilized to assist in orienteering as described.

Non-limiting examples may include image-based identification where adevice with some imaging means, including but not limited to a mobiledevice sensor, tablet device sensor, computer sensor, security sensor,or AR headset sensor, may image points of interest in a direction ofinterest. These points of interest may be identified. Image recognitionsoftware may be used to identify the visualized landscape by itsidentifying features. Machine learning may be used to train systemsusing this software to identify specific features of the environment inquestion.

To create a supplemental topographic part of a model of the environmentof a user, laser scanning and/or LiDAR may be performed during theacquisition of imagery for a reference database. A resultingthree-dimensional shape model may be modelled with the captured imageryto help in the comparison to user data. Three-dimensional shapes can beused to infer comparative imagery at different angles of acquisitionthan exist in a database. In another example, a device of a user mayhave the means of performing laser scanning or LiDAR scanning of theenvironment as well as obtaining images. The resultant three-dimensionaldata or a composite of the three-dimensional data, and the imagery maybe used to recognize features and determine a direction that the userwas facing when they collected the image.

The results of scanning may be stored and presented in differentmanners. In some examples, scanned data may be represented by a pointcloud representation; in other examples an estimated topographic surfacerepresentation may be used to visualize the three-dimensional shape dataobtained. In some examples, outward facing planes of the surfacetopography may have the captured imagery superimposed upon them. Theresulting image and three-dimensional models may be used to calculate adirection of interest or a device field of view in a dynamic sense oralternatively upon user request.

In some examples other methods of capturing spatially accurateinformation may include the use of drones and optical scanningtechniques which may include high resolution imagery obtained frommultiple viewpoints. Scanning may be performed with light based methodssuch as a CCD sensor. Other methods may include infrared, ultraviolet,acoustic, and magnetic and electric field mapping techniques.

In other embodiments, a single distance to a point of interest in animage, which may be obtained by a laser, other collimated light source,sound source or the like, may be used with models of the environment ofthe user. A comparison of the imagery and the measurement of thedistance of the user to a prominent feature in the image may allow foran orientation of the user to be determined algorithmically.

Referring now to FIG. 2, according to the present invention an Agent,such as a human person 201, supports one or more Transceivers 204-212within a wireless communication area, such as an interior of a structure200. The Agent supported Transceivers 204-212 are operative towirelessly communicate with Reference Point Transceivers 202A-D locatedwithin the structure 200. Information included in wirelesscommunications between the Reference Point Transceivers and the Agentsupported Transceivers 204-212 include values for variables that may beused to generate a position of the Agent supported Transceivers 204-212.

The Agent supported Transceivers 204-212 are co-located with the Agentresulting from being supported by the Agent, therefore a position of theperson 201 may be designated as being the same as the position of one ormore of the Agent supported Transceivers 204-212 or some mathematicalcorrelation of the respective positions of the Agent supportedTransceivers 204-212, such as for example: an average, a weightedaverage, a mean, a median, other function or algorithm involving therespective positions of two or more to the Agent supported Transceivers204-212.

In some embodiments, a person 201 (or other Agent or mammal) willsupport two or more Transceivers 204-212 and each of the Agent supportedTransceivers 204-212 will enter into communication with the ReferencePoint Transceivers 202A-D in a manner conducive to generating arespective position of the two or more Agent supported Transceivers204-212 supported by the person 201. A directional vector and/or ray maybe calculated based upon respective positions of two or more of theAgent supported Transceivers 204-212 supported by the person 201. Thedirectional vector and/or ray may be used, for example, to designate aforward facing position of the person 201 or a direction of interestassociated with the person 201. For example (and discussed in moredetail below) headgear 251 may include multiple headgear mountedtransceivers 211, such as a transceiver 211 along a front portion of aheadgear (front brim or front headband portion or front of eyeglasses)and a second headgear transceiver along a rear portion of the headgear(not shown in FIG. 2) a directional vector and/or ray may be generatedfrom the position of the transceiver along a rear portion of theheadgear through a front portion of the headgear (defined by theposition of the front portion headgear transceiver 211) and a frontwardfacing direction (and/or a rearward or sideways facing direction) may bedesignated based upon the directional vector/ray.

Other wearable items 252-257 may also include Transceivers 204-212, suchas those supported at areas of the person 201 other than the person'shead. By way of example, Transceivers 204-212 may be attached to,incorporated into, mounted on, held by, or otherwise supported by itemswearable by a person 201 or items that may be held in the person's hand.

The present invention additionally provides for Sensors 204-212 (withadditional sensors illustrated and discussed in subsequent figures) thatare supported by the person 201 or located within the structure 200. Thesensors quantify a condition within the structure 200. For example, thecondition may be a physical state present in the structure or aphysiological state present in the person 201.

In some preferred embodiments, Sensors may be placed on an inner surfaceof a wearable item such the sensor has access to a skin surface on theperson 201. Access to a skin surface may allow, or improvequantification of a physiological condition (sometimes referred toherein as a Biometric). For example, access to a skin surface may allowfor electronic quantification of a body temperature, a heart rate, ablood oxygen level, a blood sugar level, blood pressure, intracranialpressure and other conditions present and quantifiable via electronicsensors supported by the person 201.

In other embodiments, a structure sensor 213 may be positioned, such asmounted on an architectural aspect or equipment item, and receive energyfrom an environment around the sensor in a manner that allows thestructure sensor 213 to quantify a condition within the environment. Forexample, a structure sensor 213 may receive environmental input 241 suchas infrared energy into the sensor and based upon the receipt ofenvironmental input 241, such as for example infrared energy, thestructural sensor 213 may quantify surface temperatures of items withinthe structure 200. The items within the structure may include person(2)and the structural sensor may quantify a respective surface temperatureof each person 201-201A. If a structural sensor 213 is positioned toreceive environmental input, such as infrared energy 241 from a knownarea, the position of a person 201-201A may be determined via wirelesscommunications (as discussed herein) and a quantified temperature may becorrelated to a particular person based upon the location of the person201-201A and the known area monitored and quantified by the structuralsensor 213.

In another aspect, a location of Agent supported Transceivers 204-212may be determined via wireless communications with Reference PointTransceivers 202A-D and used to designate a forward facing direction ofa person 201 at a particular instance in time. Therefore, one or moreof: triangulation, trilateration and determination of an angle oftransceiving may be used to designate a forward facing position. Forexample, an AoD and/or AoA may be used to designate a frontward facingdirection (or rearward, sideways facing direction) at a particularinstance in time (and/or timeframe) while triangulation is used togenerate a geospatial position during the same timeframe (or anoverlapping timeframe).

As illustrated in FIG. 2, as well as in FIGS. 2A-2F, according to someembodiments of the present invention, sensors 214-236 are also placed inand/or on a wearable item 251-257. The sensors may quantify a conditionin an environment that is ambient to the person 201 or quantify acondition experienced by the person 201. For example, a sensor worn in awrist strap 253 type item, such as a watch or a compressive band orother type wrist strap 253 may include one or more sensor(s) thatquantify a condition experienced by the person 201 by measuringphysiological conditions experienced by the person, such as, forexample: a body temperature, a heart rate, a skin temperature, shaking,falling, impact, vibration, acceleration, deceleration, remainingstationary, appendage movement, head movement, eye movement, and thelike.

Sensors in other wearable items, may quantify similar or variantconditions. For example, an accelerometer or piezo device in a footwear256 may quantify steps. A Transceiver in a ring 212 may quantify handmovement, such as a natural swing movement during walking or running, arotational movement while operating a steering wheel, a verticalmovement while lifting or climbing a ladder, etc., and in someembodiments may work in correlation with an image capture device, suchas stereoscopic cameras in a head gear 251 to quantify hand and fingermovements that may be processed and translated into control commands.

An eye covering 257 type item supported by the person may include, forexample, eye glasses, goggles, an augmented reality (A/R) headset, avirtual reality (V/R) headset, facemask or other item that is generallyplaced in position in front of a person's 201 eyes may include one ormultiple transceivers 205 that may transceive to help determine aposition of the person 201 wearing the eye covering 257. The one ormultiple transceivers 205 may also transceive in a manner that allowsfor determination of a forward direction of the eye covering 257 suchthat a designation of a direction the person 201 is facing may becorrelated with the forward direction of the eye covering 257. Theforward direction of the eye covering may be determined according to themethods and devices discussed herein for determining a direction, suchas a direction of interest.

In another aspect, one or more sensors 237 mounted on the eye covering257 may monitor and quantify eye movement and a direction of eye focus.A direction of eye focus quantified by the sensor 237 may assist indetermining one or more of: a forward facing direction, what the eye isfocused on, whether the person 201 is looking down or up, nystagmusmovement or other health and/or performance condition.

As discussed above, Transceivers 212-236 may be mounted on a wearableitem 251-257 such that as a wearable items with one or more Transceivers212-236 and a Transceiver 204-212 may quantify a condition experiencedby the person 201 wearing the wearable item 251-257. A conditionexperienced by the person may include one or more physiological state(s)of the person 201, such as, for example, a heartrate, a bodytemperature, a breathing rate, breathing pause, eye movement, bodyconductivity, body capacitance, or other biophysical and/or biochemicalstate or condition.

Sensors incorporated into a wearable item may therefore providequantification of bodily conditions present in the wearer. Thequantified body conditions may be transmitted via a wirelesscommunication to a processor that is operative to identify a bodilycondition. For example, the processor may check to ascertain if aquantified body condition is within thresholds determined to indicate ahealthy condition of the body; or if the quantified body conditionindicates a transitory state that may ultimately result in an unhealthystate; or if the quantified body condition indicates a present state ofa human body that is in an unhealthy state.

As further discussed herein, a condition quantified by a sensor mayprecede execution of a remedial action based upon a value of a variableused to represent the condition quantified by the sensor. In thoseembodiments that include a body condition being quantified by a sensorworn in a wearable item 251-257 by a person 201, a remedial action mayinclude, by way of non-limiting, one or more of: alerting the person 201wearing the wearable item 251-257. An alert to the person 201 wearingthe wearable item 251-257 may include, for example, a human audiblealert, a kinetic action, such as a vibration or TENS (Transcutaneouselectrical nerve stimulation), a visual indication (such as a light), oractivation of another device perceptible by the person 201. An alert mayalso be generated that is communicated to a person other than the person201 wearing the wearable item 251-257, or a server, processor,controller or other automation. For example, a supervisor in aprocessing plant may receive one or both of an email and a text messageindicating that a person 201 wearing a wearable item 251-257 and workingin the processing plant has a body temperature that exceeds 100° F. andan elevated heartrate. The supervisor may recognize that a fever andelevated heartrate may be indicative of a viral infection and thereforecontact the person 201 wearing the wearable item 251-257 and direct theperson 201 to be further assessed. In addition, because the person willalso be associated with wireless position tracking via a transceiverincluded in a wearable wrist band, the present invention may determinewhere the person 201 has moved about while the person 201 has generatedan indication of a fever, e.g. an elevated body temperature. Moreover, aposition of a first person 201 may be determined relative to a positionof a second person 201A during one or more time intervals. Additionalremedial actions may be implemented if the first person 201 has beenlocated at a position within a threshold distance 240 from the secondperson 201A. For example, both the first person 201 and the secondperson 201A may be placed in quarantine until such time as it isdetermined that both the first person 201 and the second person 201A arefree of viral infection. Alternatively, in some embodiments, acomparison of a first pattern of wireless positions indicative of a pathtravelled by a first person 201 and a second pattern of wirelesspositions indicative of a path travelled by a second person 201A mayindicate that the second person 201A is not likely to contract a virusfrom the first person 201 because the second person 201A did not comewithin a distance 240 determined to be statistically favorable totransfer of the virus.

In some embodiments, a Transceivers 212-236 may quantify almost anycondition present in an area defined by a range of a Reference PointTransceiver 202A-202D communicating with a Transceivers 204-212associated with a Transceivers 212-236. Embodiments will include an areaof communication between the Transceiver 204-212 and the Reference PointTransceivers 202A-202D that includes an interior of a facility or otherstructure 200, and an area immediately surrounding the structure. Asdiscussed above, a condition quantified by sensors within range of theReference Point Transceivers 202A-202D may be a physiological state of aperson 201. In addition, the condition quantified by sensors withinrange of the Reference Point Transceivers 202A-202D may include acondition in an environment within the area, such as an atmosphericenvironment and/or a condition in a structure 200 or an item ofmachinery.

As such, in some embodiments, a wearable item 251-257 that includes awristband, headgear, vest, gown, footwear, or other capable of assessinga condition of a person 201 and an environment item, may include sensors214-236 that quantify a condition present in the person 201 that wearsthe wearable item 251-257 or a condition ambient to the person 201wearing the wearable item 251-257. Non-limiting examples of conditionsambient to a person include, temperature, humidity, visible light, IRlight, UV light, other electromagnetic energy within a definedbandwidth, movement, vibration, impact, noise, motion or otherquantifiable condition.

In some embodiments, one or more sensors 213 may be positioned otherthan as part of a wearable item 251-257. For example, a sensor 213 maybe fixedly attached to a structure 200. The structural sensor 213attached to the structure 200 may receive environmental input 241descriptive of an environment surrounding a person 201-201A. The presentinvention is able to generate a position of a person 201-201A, quantifya condition in an environment 238 surrounding the person 201-201A,quantify a condition present as a physiological state of the person201-201A at multiple instances in time and store each position andquantified condition. In addition, the present invention may generate auser interface indicating a present status of the above listedconditions, a chronology of states of conditions and positions, asummary (including mathematical analysis, such as average, mean,weighted average, median etc.).

The present invention will also provide a user interface or other humandiscernable device, such as a light, audio instruction, mechanicalactuation, video, narrative or other communication medium to indicatewhat actions the controller deems to be appropriate based upon aparticular set of conditions quantified by the sensors 214-236 andalgorithmic analysis, such as unstructured queries and artificialintelligence. For example, for a viral contagion, such as, for example,COVID-19, a close contact may be defined as anyone who was within sixfeet of an infected person for at least 15 minutes starting from 48hours before the person began feeling sick, if it is known that thevirus propagates well in an environment with certain temperature andhumidity conditions and does not propagate well in an environment withother temperature and humidity conditions, then the present inventionmay provide an interface indicating a first value for remedial action,such as a distance 240 between persons 201-201A to maintain, or whatshould be considered “close contact” based upon a first set ofenvironmental conditions that are quantified, and a second value forwhat should be considered “close contact” for a second set ofenvironmental conditions.

More specifically, if an exemplary virus propagates well in anenvironment of less than about 10° C. and in humidity of less than about75%; and the same virus has limited propagation in environments of over20° C. and atmospheric humidity of about 80% or more, then the presentinvention may provide an interface or other indicator of a distance 240defining a first value for a “close contact” based upon a temperatureand humidity of an environment in which a people are situated; e.g. afirst value defining a distance 240 between persons 201-201A for closecontact as 6 feet or less and a second value defining a distance 240between persons 201-201A for close contact as 12 feet or less. A choiceof the first value for clos contact and the second value for closecontact will be contingent upon measured quantifications of atemperature and humidity of an environment 238 in which a person201-201A is situated. Other quantified environmental conditions maybecome a factor upon which user interface values are based.

In addition to a suggested distance 240 to maintain between persons201-201A, the present invention provides to sequential positiondetermination for persons 201-201A based upon wireless communication(position based upon wireless communication is discussed in more detailherein). According to the present invention, wireless communicationincluding values of variables capable of determining a position of atransceiver supported by an Agent, such as a person 201-201A isconducted on a periodic and/or episodic basis. Periodic basis includes atimes period between wireless communications, such as every t seconds,or every minute, or every five minutes or other time period appropriateto the circumstances, such as a likelihood of movement and powerconsumption. A wireless communication based upon an episodic basis mayinclude wireless communicating as a response to an event, such asmovement detected by a lower powered device, such as accelerometers,solid state magnetic sensors, gimbals and the like, or other relativelylow powered device that is capable of detecting movement. Other eventsmay also precede a wireless communication, such as a detection ofanother person within a defined distance 240, a change in anothervariable, such as temperature, carbon dioxide level, inert gas level,oxygen level, presence of a chemical, or almost any other measurablequantity. Essentially, if a threshold level of a quantifiable conditionis reached, an onboard controller is programmed to conduct wirelesscommunication and calculation of a position of a transceiver conductingthe wireless communication.

In another aspect, environmental conditions and person conditions may bemeasured by sensors included in wearable items worn by a person, or bysensors located in a position conducive to quantifying a condition ofone or both of an environment 238 in which the person 201-201A islocated and a position conducive to quantifying a condition inherent inthe person 201-201A. For example, a sensor 213, such as an infrared(IR), thermistor, thermocouple, or other sensor type may receiveenvironmental input 241 that the sensor 213 may use to quantify acondition, such as, a temperature of the environment 238 or a conditionof a person 201-201A. The sensor 214-236 may be located in a wearableitem 251-257, or a sensor 213 may be fixed or removably fixed, in aposition in a structure 200. Either way a sensor 213-236 may beoperative to quantify a temperature condition of a person 201-201A or anenvironment 240. A value generated by a sensor 213-236 may be storedand/or processed by a controller. Processing may include a mathematicalcombination of a sensor reading with other sensor readings. A sensorreading may include a sensor generated value of a variable. Combining ofvalues of variables may include aggregating and mathematicallyprocessing the sensor generated values of variables.

As illustrated, a wearable item 251-257 may include, by way ofnon-limiting example, headgear 251, such as a hat, hardhat, headband,skull cap, cap, A/R headset, V/R headset, surgical cap, scrub cap; anearring 252; an wrist strap 253, including an arm band, a watch, abracelet, or other item that may be positioned around an arm; a torsocovering 254, such as a vest, lab coat, scrub; hazmat suit, smock; aring 255, footwear 256, such as a shoe, boot, sandal, slipper, cleat,sneaker, or other article fitted to a foot. As illustrated, each of thewearable items illustrated 251-257 has a Transceivers 204-212 associatedwith it. The Transceivers 204-212 may be fixedly attached, removablyattached or incorporated into the wearable item.

In some embodiments, a wearable item 251-257, such as for example a ring255, an earring 252, or any of the other wearable items may include atransceiver that engages in low power, short distance communication,such as for example, one or more of: LPWAN, WhiskerRF, ANT, Near FieldCommunications (NFC), Zigby, Bluetooth Low Energy, or other low energytype communication. The wearable item may then communicate sensor datato a higher powered smart device 239, such as one or more of: acommunications Tag, a Node, a Smart Phone, a Smart headset, a smartwatch and the like, wherein the higher powered smart device 239 mayengage in wireless communication with one or more Reference PointTransceivers 202A-202D to determine a position of a person 201-201A andalso convey through the wireless communications some or all of thedigital content generated by sensors 214-236 included with the wearableitem 251-257.

For example, in some embodiments a higher powered smart device 239 mayreceive from the lower powered sensor multiple values of a variablequantifying a condition present in a structure 200, each value of thevariable quantifying a condition present in the structure associatedwith a chronological time value. Variables, and values for variableswill depend upon a type of sensor made operative to quantify acondition. Sensors may be chosen based upon which conditions will bequantified. Similarly, a transceiver 202A-213 may vary based upon anenvironment in which the transceiver will be deployed.

Sensors 214-236 may include an accelerometer to quantify motion(movement, acceleration); magnetic sensor, which may include magneticfield sensors, Hall Effect Sensors and/or Anisotropic Magneto-Resistive(AMR) sensors, magnetometer (3-axis); ambient temperature sensor;ambient light sensor; specific wavelength of light sensor; viii) ambienthumidity; Magnet detector (maintenance button, “docked” indication,etc.); ix) sound pressure level (SPL); optical proximity sensor; powersource such as a rechargeable lithium polymer battery; USB connector forcharging and/or data transfer; NFC (near field communications) (tag orreader); Battery voltage sensing; audio alert, such as a Beeper;Vibrator; LED indicator(s); manual switch such as a tactile button;Inductive charging; vibration detection; air quality sensing such asCO2, VOC and the like; specific gas detection (CO, CO2, H2S,particulate); Gesture sensing (sense hand swipes over device); tap anddouble tap detection; Agent fall detection; freefall detection; shockand/or impact detection; IR (infrared) beacon TX and/or RX; pedometer;activity meter; processor enhanced audio monitoring (e.g. listen forfire alarm siren); heartrate monitor; blood oxygen sensing; OLEDdisplay; electronic ink display; and most any other electronic sensor ofa quantifiable condition.

By way of non-limiting example Transceivers 202-212 may be operative toperform wireless communications suitable for real time locationfunctionality and/or data transfer, transmitting and receivingcapabilities using one or more modalities such as: UWB; Bluetooth,including BLE; WiFi RTT; infrared; ultrasonic; sonic; sub GHz; or othermodality.

In some embodiments, communication between transceiver, such as thoseincluded in Tags, Nodes and/or Smart Devices may be achieved by a bursttransmission protocol, such as low-power derivative of Gaussian pulses.In exemplary embodiments, the burst transmission protocol may transmitradio waves having a frequency of 3.0 GHz-11.0 GHz, with a highbandwidth of approximately 500 MHz-1.3 GHz. In some embodiments, thebandwidth may be based on a tolerance from an arithmetic centralfrequency; for example, if the central frequency for the bursttransmissions is 6.0 GHz, then the bandwidth may be a relativetolerance, such as 20% of 6.0 GHz (i.e., 1.2 GHz). An interval betweenindividual pulses may be uniform or variable, based on an implementedencoding scheme. In some exemplary embodiments, burst transmissions maylack carrier waves. Transceiving modalities that may be implementedusing burst transmission protocol according to the present invention,include, ultra-wideband, sub-GHz, and industrial, scientific and medical(“ISM”) radio bands within the frequency range of 6.7 MHz (megahertz)and 250 GHz.

In some exemplary embodiments, one or more pulses of wirelesscommunication may be relatively short in duration (i.e., 0.01 ns-10 ns).The total pulse train may be written as the sum of individual,time-shifted pulses; i.e., s(t)=Σ_(n=0) ^(∞)a_(n)p (t−τ_(n)), where s(t)is the pulse train signal, p(t) is a characteristic pulse shape, a_(n)is the amplitude of the nth pulse, and τ_(n) is the time-offset of thenth pulse.

When two nodes exchange burst transmissions, they may be able to detecta range or distance between the two nodes. This may be accomplishedthrough a “time of flight” (ToF) measurement. The ToF measurement may bemade by or supplemented with a time difference of arrival (TDOA) or timedelay estimation (TDE). TDOA may rely on a measurement of the amount oftime it takes for a signal transmitted by one node to reach a pluralityof other nodes. Using multilateration techniques, a location of thetransmitting node may be estimated.

Referring now to FIGS. 2A-2E, in various embodiments, a wearable item251-256 may take appropriate forms adapted to be worn or otherwisesupported by various parts of a human person 201-201A. For example, FIG.2A illustrates an arm supported wearable item 253 which may be in theform of a wrist band or arm band or other item that is securable orotherwise supported on an arm of a human person. FIG. 2A alsoillustrates a finger supported wearable item 255 in the form a ring orother device securable upon a finger of a human person 201-201A. FIGS.2B-2C illustrate torso supported wearable items 254-254A including avest 254 and a lab coat 254A or other gown type apparel. FIG. 2Dillustrates footwear 256 and FIG. 2E illustrates a wearable item in theform of a headgear 251.

Each wearable item 251-256 may include at least one wireless transceiver204-212 and one or more sensors 213-236. As discussed herein, thewireless transceiver 204-212 may include a solid state componentsoperable to transmit and/or receive wireless communications. Thewireless communications may utilize any of the modalities discussedherein. The transceivers may wirelessly communicate with one or moreReference Point Transceivers 202A-202D and/or a smart device 239, suchas a smart phone, smart tablet, smart headgear and the like. Wirelesscommunications may include relatively higher powered and longer rangemodality, such as UWB, Bluetooth, WiFi, cellular or satellitecommunications and/or lower powered and shorter range communicationmodality, such as Zigby, ANT, BLE, or other low power protocol.

Those wearable items 251-256 that are capable of supporting more thanone wireless transceiver may be operative to engage in wirelesscommunications with Reference Point Transceivers 202A-202D and generatepositional coordinates for each transceiver 204-212 (as illustratedwearable items 251, 254, 256 include multiple transceivers, but anywearable item with a large enough area may include multiple transceivers204-212). Two or more sets of positional coordinates may be referencedto generate a direction of interest. In the present invention adirection of interest may include a direction a person 201-201A isfacing. Accordingly, a headgear 251, a vest 254 and/or a shoe 256 mayinclude multiple transceivers 211A-211D, 207-209 and 204-204Arespectively for which corresponding positional coordinates may begenerated based upon values of variables transceived according to themethods an apparatus described herein. The multiple positionalcoordinates may be used in turn to generate a direction of interest,such as, a forward facing direction. A forward facing direction may beimportant in certain safety situations, such as in the case of acontagion that may be spread by a cough, sneeze of exhale. It may beimportant to know a separation distance 203 between a first person 201to a second person 201A in the forward direction. A separation distance203 in a rearward direction may not have as short a critical distance.

In some embodiments, Sensors 213-236 are hardwired or otherwise inphysical logical communication with connected to transceivers 204-212included in a same wearable device. In physical logical communicationmay include, by way of non-limiting example, on a same printed circuitboard (PCB); in a same semiconductor chip; connected by a circuit traceror wired connection; or other physical logic pathway capable ofconveying a digital value.

Transceivers 213-236 may be operative to engage in wirelesscommunication with one or more of: Reference Point Transceivers202A-202D; a smart device 239, such as a Smart Phone, Smart Tablet orSmart Headgear; a cellular network; a satellite network; a mesh networkor other logical network.

Referring now to FIG. 2F, a first person 201 and a second person 201Aare illustrated in place to interact with processing equipment 260.Transceivers 207-208 may be supported by the persons 201-201A and engagein wireless communications 243 with one or more Reference PointTransceivers 202A-202D, and values for variables included in thewireless communications 243 may be used to generate location coordinatesindicating a respective location 263-264 for the persons 201-201A.Various communications 265-269 are illustrated. Respective locations263-264 may be referenced to determine separation distance 203 betweenpersons 201-201A and also a separation distance between a person 201Aand an item of equipment 260 or other item surface, such as a surface ofa product 261. For products such as food items or pharmaceuticals,contamination with a contagion may be particularly sensitive. Separationdistance 203-203A may be used to determine a risk on contamination witha contagion. A length of time may also be determined based upon asequence of wireless communications 243 at known time intervals, whereinthe wireless communications are used to generate a location 263-264 ofan Agent, such as a person 201-201A.

Ongoing determination of a location 263-264 of an Agent, such as aperson 201-201A may also be used to ensure that the person 201-201A doesnot traverse and area designated as a contaminated area, such as a rawfood area, or a chemically contaminated area, and then proceed to acontrolled area, such as a non-contaminated area, such as an area withfood or other product ready for distribution to the public.

Devices involved in the generation and/or storage and/or transmitting ofdigital content, such as, one or more of: agent supported transceivers207-208, reference point transceivers 202A-202D, gateways 270, andservers 271 may each engage in direct logical communications and/or inlogical communications with an intermediary device. For example, areference point transceiver 202A-202D may engage in logicalcommunication with a gateway 270 or other intermediary device and thegateway 270 may engage in logical communication 269 with a server 271;or the reference point transceiver 202A-202D may engage in logicalcommunication 267 directly with the server 271. In various embodimentsof the present invention, any or all of the devices (e.g. sensors,transceivers, gateways, servers) involved in generation and/or storageand/or transmitting of digital content, may aggregate, store and orprocess digital content that the device has access to.

Also, variations on a location of a sensor and a transceiver are withinthe scope of the present invention. As discussed above, a Sensor 204-213may be located on a wearable item 251-257 or a sensor 213 may bepositioned at a point extraneous to a person 201-201A, such as mountedon an architectural aspect (such as, for example, a doorway, a hallentrance, a turnstile or other crowd movement control device; andreceive sensor input 242 from a person 201 useful to quantify acondition of the person 201. Transceivers 207-208 may determine alocation of a person 201-201A that correlates with a sensor 213quantification of a condition present with the person 201-201A basedupon input 242 received from the person 201-201A. Based upon a location263 of a person 201, a processor (such as those present in a gateway270, server 271 or smart device 239) which person is associated with acondition quantified by the sensor 213 mounted on an architecturalaspect.

Some embodiments may also include a sensor 213 capable of receivinginput 242 sufficient to quantify biometric based identification of theperson 201, and/or a physiological state present in the person 201. Forexample, sensor 213 may receive input enabling facial recognition of theperson 201 and correlate input from a sensor 204-213 to quantify aphysiological condition and a facial recognition identification.Transceivers 207-208 may engage in wireless communications sufficient todetermine a location 263 of the person 201 when the physiologicalcondition and a facial recognition identification took place via othersensors than those co-located with the transceivers supported by theAgent.

Referring now to FIG. 3, methods and devices for determining a directionthat may be referenced for one or both of data capture and datapresentation of a particular portion of the virtual representation ofsurroundings of a user. An Agent 300 may position a Transceiver 305 in afirst position 301 proximate to a portion in a space of interest 325.The first position 301 of the Transceiver 305 may be determined andrecorded. The Agent 300 may then relocate the Transceiver 305 to asecond position 302 in a general direction of the portion in space ofinterest. With associated position information obtained for the firstand second positions a controller in an external system or in anassociated Transceiver 305 may generate one or both of a ray and avector towards the portion of a space of interest.

In some embodiments, the vector may have a length determined by acontroller that is based upon a distance to a feature of interest inspace as represented in a model on the controller in the direction ofthe generated vector. The vector may represent a distance 303 from thesecond position 302 to the space of interest 325 along the axis definedby a line between the first position 301 and the second position 302. Incontrast, a ray may include just a starting point and a direction.

In still other embodiments, a device with a controller and anaccelerometer, such as mobile phone, tablet or other Smart Device thatincludes a Transceiver 305, may include a user display that allows adirection to be indicated by movement of the device from a determinedlocation acting as a base position towards an point in a direction ofinterest or representing a center of an RTA of the device. The movementmay occur to a second location in an extended position. In someimplementations, the Smart Device determines a first position 301 basedupon triangulation with the reference points. The process ofdetermination of a position based upon triangulation with the referencepoints may be accomplished, for example via executable softwareinteracting with a controller in the Smart Device, such as, for exampleby running an app on the Transceiver 305.

An array of antennas positioned at a user reference point may allow forthe accurate receipt of orientation information from a transmitter. Asdiscussed earlier a combination devices with arrays of antennas may beused to calculation a position. A single Node with an array of antennascan be used for orienteering and determining a direction of interest.Each of the antennas in such an array receiving a signal from a sourcemay have different phase aspects of the received signal at the antennasdue to different distances that the emitted signal passes through. Thephase differences can be turned into a computed angle that the sourcemakes with the antenna array.

Referring to FIGS. 4A-D a series of exemplary devices employing matrices(or arrays) of antennas for use with Nodes that communicate wirelessly,such as via exemplary UWB, Sonic, Bluetooth, a Wi-Fi or other modality,is illustrated. Linear antenna arrays 401 are illustrated in FIG. 4A.Rectangular antenna arrays 402 are illustrated in FIG. 4B. Circularantenna arrays 403 are illustrated in FIG. 4C, other shapes for arraysare within the scope of the invention. In addition, an antenna array maybe omni-directional or directional.

In some embodiments, see FIG. 4D item 404, a Smart Device 405 mayinclude one or more Nodes 406 internal to the Smart Device 405 orfixedly attached or removably attached to the Smart Device 405. EachNode 406 may include antenna arrays combined with a power source andcircuitry to form complete self-contained devices. The Nodes 406 or acontroller may determine an RTT, time of arrival, AoA and/or AoD orother related angular determinations based upon values for variablesinvolved in wireless communications. For example, a composite device 404may be formed when a Node 406 with a configuration of antennas, such asthe illustrated exemplary circular configuration of antennas 407, isattached to a Smart Device 405. The Node 406 attached to the SmartDevice 405 may communicate information from and to the Smart Device 405including calculated results received from or about another Node 406,such as a Node 406 fixed as a Reference Point Transceiver or a Node withdynamic locations, wherein the wireless communications are conducive togeneration of data useful for determination of a position (e.g. timingdata, angles of departure and/or arrival, amplitude, strength, phasechange, etc.). A combination of angles from multiple fixed referencepoints to the antenna array can allow for a location of a user in space.However, with even a single wireless source able to communicate with theantenna array, it may be possible to determine a direction of interestor a device related field of view.

An array of antennas positioned at a reference point may allow for theaccurate receipt of orientation information from a transmitter. Asdiscussed earlier a combination devices with arrays of antennas may beused to calculation a position. A single Node with an array of antennascan be used for orienteering and determining a direction of interest.Each of the antennas in such an array receiving a signal from a sourcewill have different phase aspects of the received signal at the antennasdue to different distances that the emitted signal passes through. Thephase differences can be turned into a computed angle that the sourcemakes with the antenna array.

Referring now to FIG. 5A, in some embodiments, one or both of a SmartDevice 501 and a Smart Receptacle 502 may incorporate multipleTransceivers 503-510 and a direction of interest may be ascertained bygenerating a vector 526 passing through a respective position of each ofat least two of the transceivers (as illustrated through transceiver 505and 507). The respective positions of each of the Transceivers 503-510supported by the Smart Device 501 and/or Smart Receptacle 502 may beascertained according to the methods presented herein, including forexample via triangulation, trilateration, signal strength analysis, RTT,AoD, AoA, topography recognition, and the like. Reference PositionTransceivers 511-514 may be fixed in a certain location.

In some embodiments, one or both of the Smart Device 501 and the SmartReceptacle 502 incorporating Transceivers 503-510 may be rotated in amanner (such as, for example in a clockwise or counterclockwise movement520, 522 relative to a display screen 515) that repositions one or moreTransceivers 503-510 from a first position to a second position. Avector 526 may be generated at an angle that is zero degrees with aplane of a display screen 515 or perpendicular 525 or some otherdesignated angle in relation to the Smart Device 501 and an associateddisplay screen 515. In some embodiments, an angle in relation to theSmart Device 501 is perpendicular 525 to a display screen 515 andthereby viewable via a forward-looking sensor (or other CCD or LIDARdevice) on the smart device. In addition, a mirror or otherangle-altering device may be used in conjunction with a CCD, LIDAR orother energy receiving device.

Movements of a Smart Device 501 equipped with an antenna array can bedetermined via relative positions of the antenna and/or via operation ofan accelerometer within the Smart Device 501 or Smart Receptacle 502.Rough movement sense may be inferred with a single source to the antennaarray. However, with multiple sources, the positional movement of eachof the antennas can be used to sense many types of movements includingtranslations and rotations.

A user may position the Smart Device 501 such that an object in adirection of interest 525 is within in the CCD view. The Smart Device501 may then be moved to reposition one or more of the Transceivers503-510 from a first position to a second position and thereby capturethe direction of interest 525 via a generation of a vector 526 in thedirection of interest 525.

In addition to movement of the Smart Device 501 and/or the SmartReceptacle 502 may include a magnetic force detection device 523, suchas a magnetometer. A registration of a magnetic force may be determinedin relation to a particular direction of interest 525 and a subsequentdetermination of magnetic force referenced or provide a subsequentorientation of the Smart Device 501 or Smart Receptable 502.

In some embodiments, the magnetic force detection device 523 may be usedcombination with, or in place of directional movement of the SmartDevice Transceivers 503-507 to quantify a direction of interest 525 to auser. Embodiments may include an electronic and/or magnetic sensor toindicate a direction of interest 525 when a Smart Device 501 and/orSmart Receptacle 502 is aligned in a direction of interest 525.Alignment may include, for example, pointing a specified side of a SmartDevice 501 and/or Smart Receptacle 502, or pointing an arrow or othersymbol displayed upon a user interface on the Smart Device 501 towards adirection of interest 525.

A magnetic force detection device 523 may detect a magnetic fieldparticular to a setting that a Smart Device is located. For example, insome embodiments, a particular structure or other setting may have amagnetic force that is primarily subject to the earth's magnetic fieldor may be primarily subject to electromagnetic forces from equipment,power lines, or some other magnetic influence or disturbance. An initialquantification of a magnetic influence at a first instance in time maybe completed and may be compared to a subsequent quantification ofmagnetic influence at a later instance in time. In this manner aninitial direction of interest indicated by a position, orientation,pitch and yaw of a Node, such as a Smart Device may be compared to asubsequent position, orientation, pitch and yaw of the Smart Device.

In some embodiments, an initial position, pitch and yaw of a SmartDevice 501 may be described as a relative angle to a presiding magneticforce. Examples of presiding magnetic forces include, magneticinfluences of electrical charges, Earth's magnetic field, magnetizedmaterials, permanent magnetic material, strong magnetic fields,ferromagnetism, ferrimagnetism, antiferromagnetism, paramagnetism, anddiamagnetism, or electric fields that are generated at reference nodesat known positions which may be locally used to indicate a direction ofinterest.

Smart devices may include electronic magnetic sensors as part of theirdevice infrastructure. The magnetic sensors may typically includesensing elements deployed along three axis. In some examples, themagnetic sensors may be supplemented with electronic accelerometers,such as MEMS accelerometers.

In some examples the magnetic sensors may measure a sensed magneticfield perpendicular to the body of the sensor through a Hall effectsensor. In some examples, a Hall effect sensor may be built into siliconto generate a relatively sensitive sensing capability for magneticfields. In some Hall effect sensors, electrons and holes flowing in aregion of the silicon may interact with the regional magnetic field andbuild up on the fringes of the conduction region, thus generating ameasurable voltage potential. In other examples, anisotropicmagnetoresistance sensors may sensitively detect the magnetic field atthe device as a significant change in resistance of structure elementsin the device.

In still further examples, giant magnetoresistance (GMR) sensors maydetect the magnetic field. In some of these examples, the GMR sensorsmay detect a magnetic field with a current-perpendicular-to-plane (CPP)GMR configuration. In other examples, a current-in-plane (CIP) GMRsensor configuration may be used. The resulting three-axis magneticsensors may perform a sensitive compass function to determine adirection of a specified portion of the Smart Device and/or an edge ofthe smart device relative to the local magnetic field environment. Aspecified portion of the Smart Device may be indicated via a userinterface presented on a screen of the Smart Device.

Referring now to FIG. 5B, as illustrated, a vector in a direction ofinterest 525 may be based upon a rocking motion 523-524 of the SmartDevice 501, such as a movement of an upper edge 518 in a forward arcuatemovement 523. The lower edge 519 may also be moved in a complementaryarcuate movement 524 or remain stationary. The movement of one or boththe upper edge 518 and lower edge 519 also results in movement of one ormore Transceivers 503-510 (Shown in FIG. 5A) and/or registration in anonboard accelerometer 534. The movement of the Transceivers 503-510(Shown in FIG. 5A) will preferably be a sufficient distance to registerdisparate geospatial positions based upon wireless transmissions and/orsufficient to register movement via the accelerometer 534.

As presented herein, a direction dimension may be based upon one or moreof: a wireless position of two or more transceivers, a movement of adevice, a magnetic force determination, a LIDAR transmission andreceiving, CCD energy determinations and other assessments of anenvironment containing the Smart Device and/or Smart Receptacle. Forexample, a device with a controller and an accelerometer, such as amobile Smart Device, may include a user display that allows a directionto be indicated by movement of the device from a determined locationacting as a base position towards a feature in the intended directionwhere the movement results in an extended position. In someimplementations, the Smart Device may first determine a first positionbased upon triangulation with the reference points and a second position(extended position) also based upon triangulation with the referencepoints.

As described above, facing a mobile device towards an area in aStructure and movement of the mobile device in a particular pattern maybe used to ascertain a specific area in space to be interpreted byvarious methods.

Referring to FIG. 5C, an illustration of an Agent 550 utilizing anoriented stereoscopic sensor system 551 to orient a direction ofinterest is shown. The stereoscopic sensor system 551 may obtain twodifferent images from different viewpoints 552-553 which may be used tocreate topographical shape profiles algorithmically. A controller mayobtain the image and topographic data and algorithmically compare themto previously stored images and topographic data in the generalenvironment of the user. The resulting comparison of the imagery andtopography may determine an orientation in space of the Agent 550 and insome examples determine a device field of view. The controller mayutilize this determined field of view for various functionality asdescribed herein.

Referring now to FIG. 6 an automated controller is illustrated that maybe used to implement various aspects of the present invention, invarious embodiments, and for various aspects of the present invention,controller 600 may be included in one or more of: a wireless tablet orhandheld device, a server, a rack mounted processor unit. The controllermay be included in one or more of the apparatus described above, such asa Smart Device, Smart Tablet, Headgear, Smart Watch, Smart Ring or otherSmart Device. The controller 600 includes a processor unit 620, such asone or more semiconductor based processors, coupled to a communicationdevice 610 configured to communicate via a communication network. Thecommunication device 610 may be used to communicate, for example, via adistributed network such as a cellular network, an IP network, theInternet or other distributed logic communication network.

The processor unit 620 is also in communication with a storage device630. The storage device 630 may comprise any appropriate informationstorage device, including combinations of digital data storage devices(e.g., solid state drives and hard disk drives), optical storagedevices, and/or semiconductor memory devices such as Random AccessMemory (RAM) devices and Read Only Memory (ROM) devices.

The storage device 630 can store a software program 640 with executablelogic for controlling the processor unit 620. The processor unit 620performs instructions of the software program 640, and thereby operatesin accordance with the present invention. The processor unit 620 mayalso cause the communication device 610 to transmit information,including, in some instances, control commands to operate apparatus toimplement the processes described above. The storage device 630 canadditionally store related data in a database 650 and database 660, asneeded.

Referring now to FIG. 7, a block diagram of an exemplary Smart Device702 is shown. Smart Device 702 comprises an optical capture device 708to capture an image and convert it to machine-compatible data, and anoptical path 706, typically a lens, an aperture or an image conduit toconvey the image from the rendered document to the optical capturedevice 708. The optical capture device 708 may incorporate a CCD, aComplementary Metal Oxide Semiconductor (CMOS) imaging device, or anoptical Sensor 724 of another type.

A microphone 710 and associated circuitry may convert the sound of theenvironment, including spoken words, into machine-compatible signals.Input facilities may exist in the form of buttons, scroll wheels, orother tactile Sensors such as touch-pads. In some embodiments, inputfacilities may include a touchscreen display.

Visual feedback to the user is possible through a visual display,touchscreen display, or indicator lights. Audible feedback 734 may comefrom a loudspeaker or other audio transducer. Tactile feedback may comefrom a vibrate module 736.

A magnetic force sensor 737, such as a Hall Effect Sensor, solid statedevice, MEMS device or other silicon based or micro-electronicapparatus.

A motion Sensor 738 and associated circuitry converts motion of theSmart Device 702 into a digital value or other machine-compatiblesignals. The motion Sensor 738 may comprise an accelerometer that may beused to sense measurable physical acceleration, orientation, vibration,and other movements. In some embodiments, motion Sensor 738 may includea gyroscope or other device to sense different motions.

A location Sensor 740 and associated circuitry may be used to determinethe location of the device. The location Sensor 740 may detect GlobalPosition System (GPS) radio signals from satellites or may also useassisted GPS where the mobile device may use a cellular network todecrease the time necessary to determine location. In some embodiments,the location Sensor 740 may use radio waves to determine the distancefrom known radio sources such as cellular towers to determine thelocation of the Smart Device 702. In some embodiments these radiosignals may be used in addition to GPS.

Smart Device 702 comprises logic 726 to interact with the various othercomponents, possibly processing the received signals into differentformats and/or interpretations. Logic 726 may be operable to read andwrite data and program instructions stored in associated storage ormemory 730 such as RAM, ROM, flash, SSD, or other suitable memory. Itmay read a time signal from the clock unit 728. In some embodiments,Smart Device 702 may have an on-board power supply 732. In otherembodiments, Smart Device 702 may be powered from a tethered connectionto another device or power source.

Smart Device 702 also includes a network interface 716 to communicatedata to a network and/or an associated computing device. Networkinterface 716 may provide two-way data communication. For example,network interface 716 may operate according to the internet protocol. Asanother example, network interface 716 may be a local area network (LAN)card allowing a data communication connection to a compatible LAN. Asanother example, network interface 716 may be a cellular antenna andassociated circuitry which may allow the mobile device to communicateover standard wireless data communication networks. In someimplementations, network interface 716 may include a Universal SerialBus (USB) to supply power or transmit data. In some embodiments, otherwireless links may also be implemented.

As an example of one use of Smart Device 702, a reader may scan somecoded information from a location marker in a facility with Smart Device702. The coded information may include for example, a hash code, barcode, RFID or other data storage device. In some embodiments, the scanmay include a bit-mapped image via the optical capture device 708. Logic726 causes the bit-mapped image to be stored in memory 730 with anassociated time-stamp read from the clock unit 728. Logic 726 may alsoperform optical character recognition (OCR) or other post-scanprocessing on the bit-mapped image to convert it to text. Logic 726 mayoptionally extract a signature from the image, for example by performinga convolution-like process to locate repeating occurrences ofcharacters, symbols or objects, and determine the distance or number ofother characters, symbols, or objects between these repeated elements.The reader may then upload the bit-mapped image (or text or othersignature, if post-scan processing has been performed by logic 726) toan associated computer via network interface 716.

As an example of another use of Smart Device 702, a reader may recitewords to create an audio file by using microphone 710 as an acousticcapture port. Logic 726 causes audio file to be stored in memory 730.Logic 726 may also perform voice recognition or other post-scanprocessing on the audio file to convert it to text. As above, the readermay then upload the audio file (or text produced by post-scan processingperformed by logic 726) to an associated computer via network interface716.

A directional sensor 741 may also be incorporated into Smart Device 702.The directional device may be a compass and be based upon a magneticreading, or based upon network settings. The magnetic sensor may includethree axes of magnetic sensitive elements and may also be coupled withan accelerometer in the directional sensor 741.

A LiDAR sensing system 751 may also be incorporated into Smart Device702. The LiDAR system may include a scannable laser light (or othercollimated) light source which may operate at nonvisible wavelengthssuch as in the infrared. An associated sensor device, sensitive to thelight of emission may be included in the system to record time andstrength of returned signal that is reflected off of surfaces in theenvironment of Smart Device 702. Aspects relating to capturing data withLiDAR and comparing it to a library of stored data (which may beobtained at multiple angles to improve accuracy) are discussed above.

Physical world and virtual-world based imagery related to theenvironment of a user may be presented via a user interface that maydisplay on a Smart Device screen or other interactive mechanism, or insome embodiments, be presented in an augmented of virtual environment,such as via a VR or AR headset. The imagery displayed upon these devicesmay represent a composite of image data reflective of a real-world datastream as well as digitally added/superimposed image data from a virtualor digital source data stream. A user may be presented a typical imageas it would look to the user's eyes physically, upon which digitalshapes representing virtual “Tags” may be superimposed to represent thepresence of digital information that may be accessed by a user. In otherexamples, the digital information may be directly displayed as asuperposition. In some examples, the real-world and virtual-worldenvironments may be displayed separately on a screen or separately intime.

In some examples, the “physical world image” may also be digitallyformed or altered. For, example, an imaging device may obtain imageswhere the sensing elements of the imaging device are sensitive to adifferent frequency of electromagnetic radiation, such as in anon-limiting sense infrared radiation. The associated “real-world image”may be a color scale representation of the images obtained in theinfrared spectrum. In still further examples, two different real-worldimages may be superimposed upon each other with or without additionalvirtual elements. Thus, a sensor image may have an IR sensor imagesuperimposed over part or all of the image and a digital shaperepresenting a virtual Tag may be superimposed.

In some implementations, a virtual reality headset may be worn by a userto provide an immersive experience from a vantage point such that theuser may experience a virtual representation of what it would be like tobe located at the vantage point within an environment at a specifiedpoint in time. The virtual representation may include a combination ofsimulated imagery, textual data, animations and the like and may bebased on scans, image acquisition and other Sensor inputs, as examples.A virtual representation may therefore include a virtual representationof image data via the visual light spectrum, image data representingimage scans obtained via infrared light spectrum, noise and vibrationreenactment. Although some specific types of exemplary sensor data havebeen described, the descriptions are not meant to be limiting unlessspecifically claimed as a limitation and it is within the scope of thisdisclosure to include a virtual representation based upon other types ofcaptured sensor data may also be included in the AVM virtual realityrepresentation.

It should be noted that although a Smart Device is generally operated bya human Agent, some embodiments of the present disclosure include acontroller, accelerometer, data storage medium, Image Capture Device,such as a CCD capture device and/or an infrared capture device beingavailable in an Agent that is an unmanned vehicle, including for examplean unmanned ground vehicle (“UGV”) such as a unit with wheels or tracksfor mobility and a radio control unit for communication. or an unmannedaerial vehicle (“UAV”) or other automation.

In some embodiments, multiple unmanned vehicles may capture data in asynchronized fashion to add depth to the image capture and/or athree-dimensional and four-dimensional (over time) aspect to thecaptured data. In some implementations, UAV position may be containedwithin a perimeter and the perimeter may have multiple reference pointsto help each UAV (or other unmanned vehicle) determine a position inrelation to static features of a building within which it is operatingand also in relation to other unmanned vehicles. Still other aspectsinclude unmanned vehicles that may not only capture data, but alsofunction to perform a task, such as paint a wall, drill a hole, cutalong a defined path, or other function. As stated throughout thisdisclosure, the captured data may be incorporated into a virtual modelof a space or Structure.

Referring now to FIGS. 8A-8G, exemplary Wireless Communication Areas(WCA) and Radio Target Areas (RTAs) are illustrated. In general, a WCAis an area through which wireless communication may be completed. A sizeof a WCA may be dependent upon a specified modality of wirelesscommunication and an environment through which the wirelesscommunication takes place. In this disclosure (and as illustrated), aWCA may be portrayed in a representative spherical shape; however, in aphysical environment, a shape of a WCA may be amorphous or of changingshape and more resemble a cloud of thinning density around the edges. Ingeneral, a RTA is an area from which an energy-receiving Sensor willreceive energy of a type and bandwidth that may be quantified by theenergy-receiving Sensor. The RTA shape and size may be affected by anenvironment through which the energy must be conveyed and furthereffected by obstructions.

According to the present invention, a WCA and RTA may be used to providean augmented reality user interface indicating a location of variouspersons within the WCA and RTA and indications of sensor readingsrelated to those persons as well as links to further information.

Referring now to FIG. 8A, a side view illustrates a WCA 800 surroundinga Node, such as a Smart Device 802. Energy 803, which is illustrated asrays, is received by one or more energy-receiving Sensors 804 in theSmart Device 802 (energy-receiving Sensors may also be in a SmartReceptacle associated with the Smart Device, though this is notillustrated in FIG. 8A). An exemplary ray 803 proceeds from a position805 within RTA 801 boundary to the energy-receiving Sensor 804.

As illustrated, a portion 801 a of the RTA 801 may flatten out inresponse to a ground plane, wall, partition, or other obstructionencountered. A Node 806 may be located on or within a surface that makesup a relevant obstruction and the Node 806 may appear to be along aperimeter of the RTA 801. Similarly, a Virtual Tag may be associatedwith location coordinates that appear on or within a floor, wall,partition, or other article acting as a radio frequency obstruction andthereby appear to be a part of the obstruction, however, since it isvirtual, the Virtual Tag will not effect the physical properties of theobstruction. Essentially, a Virtual Tag may have location coordinatesthat correspond to anywhere in the physical real-world. In someexamples, a software limit or setting may limit location coordinates ofVirtual Tags to some distance from a base position or a distance from adesignated position, such as a location of a designated Physical Tag,Reference Point Transceiver or other definable position.

In addition to obstructions, a topography of an environment within anRTA 801 may also limit wireless conveyance of energy within an RTA 801to an energy-receiving Sensor 804. Topography artifacts may include, forexample, a terrain, buildings, infrastructure, machinery, shelving orother items and/or other structures that may create impediments to thereceipt of wireless energy.

Energy received 803 into the energy-receiving Sensor 804 may be used tocreate aspects of a user interface that is descriptive of theenvironment within the RTA 801. According to the present invention,environmental aspects, Nodes 806, Tags (both physical Tags and VirtualTags) and the like may be combined with user interactive mechanisms,such as switches or other control devices built into a user interactivedevice, and included in a user interactive interface. For example,energy levels received into an energy-receiving Sensor 804 may becombined with location coordinates of Physical Tags and/or Virtual Tagsand a user interactive device may be positioned in an interactive userinterface at a position correlating with the position coordinates and besurrounded with a visual indicator or the received energy levels.

In this manner, a single user interface will include a static imagerepresentative of received energy levels at an instance in time; avisual representation of a location(s) of Physical and/or VirtualTag(s), and devices with user interactive functionality. In someembodiments, the devices with user interactive functionality may bepositioned at a location in the user interactive interface correlatingwith the position(s) of the Physical and/or Virtual Tag(s).

This disclosure will discuss RTAs 801 that are frustums of a generallyconical shape, however, RTAs 801 of other volume shapes are within thescope of the invention. For example, if an energy-receiving Sensor 804included a receiving surface that was a shape other than round, or hadmultiple receiving surfaces, each of a round or other shape, the RTA 801associated with such an energy-receiving Sensor 801 may have a shapeother than a frustum of generally conical shape.

Referring now to FIG. 8B, a top-down view of a RTA 801 is depicted. ARTA 801 will include some portion of a WCA 800. As illustrated, the WCA800 includes a space with irregular boundaries encompassing 360 degreesaround the Smart Device 802. Aspects such as topography, strength ofsignals and atmospheric conditions (or other medium through which awireless communication will travel) may affect and/or limit a perimeterof the WCA 800. A location of the RTA 801 may be referenced to determinewhich Tags (Physical and/or Virtual) such as node 806 are includedwithin an interactive user interface. Generally, preferred embodimentsmay only include Tags with location coordinates with the RTA 801 in theinteractive user interface. However, embodiments may include Tagsexternal to the RTA 801 in a particular interactive user interface.

Referring now to FIG. 8C, a side view of a WCA 800 is presented where anenergy-receiving Sensor 804 is capable of quantifying a particular formof energy, such as a particular bandwidth of energy received from a userselected RTA 807. A Smart Device 802 may incorporate or be in logicalcommunication with multiple energy receiving devices 804, each energyreceiving device capable of quantifying a limited energy spectrum in anenvironment defined by the RTA 807 selected by the user.

Some embodiments include a RTA 807 that varies according to a type ofenergy receiving device 804 receiving a corresponding type of energy.For example, an energy-receiving Sensor 804 that receives energy in alower bandwidth may have an RTA 807 that extends a greater distance thanan energy-receiving Sensor 804 that receives energy in a higherbandwidth. Similarly, some energy-receiving Sensors 804 may be effectedby forces outside of the RTA 807, such as a magnetometer which may besensitive to signal interactions around all of the WCA 800, and a RTA807 associated with a magnetometer may accordingly be the same as theWCA 800.

By way of non-limiting example, a RTA 807 for a CCD-type energy receivermay be represented as a frustum with an expansion angle of approximately60 degrees in shape. Accordingly, the RTA 807 subtends only a portion ofthe universal WCA 820.

Referring now to FIG. 8D, a top view of a WCA 800D is illustrated with aRTA 807A comprising a frustum with an expansion angle of approximately60 degrees. A Smart Device with an energy receiver 802 that quantifies aspecified bandwidth of energy from the RTA 807A may generate a userinterface with an image based upon energy quantified from RTA 807A.

In FIG. 8D, the WCA 800D is represented as a spherical area. A WCA 800Dmay be designated that is less than an entire area of possible radiocommunication using a specific designated wireless communicationmodality. For example, WCA 800D may be spherical and stay withinboundaries of a modality based upon a UWB wireless communicationprotocol.

A user interface based upon quantified energy in an RTA 807, 807A, maypresent a representation of energy within the respective RTA 807, 807Aas quantified by an energy-receiving Sensor 802. Energy levels of otherthree-dimensional spaces within the WCA 800 may be quantified by energyreceivers and presented in a user interface by directing energy from aselected three-dimensional space into the energy receivers and therebydefining a different RTA. In this manner, energy levels may bequantified from essentially any area within the WCA 820 380 andrepresented as part of a user interface. Quantified energy levels mayvary based upon a receiving Sensor. For example, a CCD Sensor mayquantify visible light spectrum energy, and a LIDAR receiver a broadspectrum, an infrared receiver may quantify infrared energy levels, andenergy-receiving Sensors. A particular feature present in a particularportion of the electromagnetic spectrum quantified by anenergy-receiving Sensor may have a unique physical shape whichcharacterizes it and which may be associated with a correspondingvirtual-world aspect and Tag associated with the location.

In some examples, as has been described, quantification of energy levelsassociated with aspects of the physical world may be for one or more of:characterizing an RTA 807, 807A by quantifying energy levels andpatterns existing at an instance in time, determining a location and/ororientation of a Smart Device 802 or other Node, such as node 806; andverifying a location and/or orientation of a Smart Device. In someexamples, energy levels associated with aspects of the physical worldmay be communicated by the Smart Device to a remote controller forfurther processing, and the remote controller may communicateinformation back to the Smart Device or to another user interface.Information communicated from the controller may include, for example,an orientation of physical and/or virtual aspects located within theuniversal RTA in relation to the Smart Device; quantified energyindicating of or more of: a topographical feature, a surfacetemperature, a vibration level, information associated with a VirtualTag, information associated with a physical Tag, sensor data, or otherinformation associated with the RTA 807A.

A view of a Radio Target Area 807-807A may be a relatively small portionof the entire WCA that surrounds a Smart Device. An area of energy to bequantified by a sensor (sometimes referred to herein as the Radio TargetArea) may be displayed surrounded by the WCA 830.

Referring now to FIG. 8E, an exemplary presentation of a RTA 844superimposed upon a representation of a WCA 841 is illustrated. The WCA841 is illustrated with a perspective view of a spheroid with analignment feature 860 such as a spheroid dividing arc, or a line. Ablackened ellipsoid feature is a representation of the RTA 844associated with a particular Smart Device which would be located at acenter of the spheroid WCA 841. If desired, one or more energy receivingdevices associated with or incorporated into a Smart Device may berepositioned or have a changed orientation in space to ultimately scanall of the accessible universal Radio Target Area space.

Referring to FIG. 8F, an illustration of how moving the one or moreenergy receiving devices around in space may alter an area defined asthe RTA 854. The same orientation of the universal WCA 841 may be notedby a same location of the alignment feature 860. Relative movement ofthe ellipsoid feature illustrates a change in an area designated as RTA854.

Referring to FIG. 8G, an illustration of adding Tag locations (which maybe Physical Tags or Virtual Tags) to a mapping of the WCA 841 isprovided. A Tag may be represented in the WCA, for example, as an icon(two- or three-dimensional) positioned in space according to acoordinate system, such as Cartesian coordinates, polar coordinates,spherical coordinates or other mechanism for designating a position.Coordinates may specify one or both of physical real-world Tags andVirtual Tags.

A location of a real-world Tag or Virtual Tag may be in either RTA 861,the WCA 841 or external to both the RTA 861 and the WCA 841. Examples ofTags outside the RTA 861 and within the WCA 841 include Tags 862-866. Anexample of a Tag in the device RTA is Tag 861. A Tag located external toof the WCA 841 and the RTA 861 includes Tag 867.

In some examples, a display on the user's Smart Device may illustrateimage data captured via a CCD included in a Smart Device. Portions ofthe image data captured via a CCD may be removed and replaced with anicon at position correlating to a position in space within the RTA 861.The icon may indicate of a Tag 861 located within the RTA 861, or atleast the direction in the RTA 864 along which the Tag 861 may belocated at an instance in time. In addition, an area of a user interfaceportraying the Icon may user interactive device such that when thedevice is activated, the Smart Device is operative to perform an action.

The actual positions of the Tags in real-world space (or the digitalequivalent in the real-world space) may be stored and maintained in adatabase. Positions of physical Tags may be determined via techniquesbased upon wireless communication and be updated periodically. A periodof update may be contingent upon variables including, user preference,Tag movement, change in environmental conditions, User query or othervariable that may be converted into a programmable command. In anotherexample of some embodiment, an Agent may interact with a user interfaceand understand the presence of Tags that are outside of the RTA 861 andadjust one or both of a position and direction that the Smart Device tocause the Smart Device to be positioned such that the RTA 861encompasses a position of the Tag of interest.

Referring to illustration FIG. 9A, an exemplary apparatus foreffectuating the methods described herein is shown, wherein Smart Device901 has within its Radio Target Area a Structure 921. Smart Device 901may display a user interface 902 based upon data generated by anenergy-receiving Sensor 903 incorporated into the Smart Device oroperative in conjunction with the Smart Device 901. The energy-receivingSensor 903 may produce data representative of an area from which theenergy-receiving Sensor 903 received energy. A user interface 902 may begenerated that is based upon relative values of some or all of the dataproduced by the energy-receiving Sensor 903.

Smart Device 901 may have its position and direction determined usingthe orienteering methods described herein, with reference to ReferencePoint Transceiver 931. The position may be determined relative to a BaseNode, which may operate as an origin in a coordinate system associatedwith Structure 921 and its surroundings. The position-determination stepmay be aided with reference to transmitter 922, which in someembodiments, may be a Reference Point Transceiver. In this example,transmitter 922 is positioned proximate to the Structure 921.

A receiver on Smart Device 901 may be operative to receive a wirelesslogical communication from transmitter 922. This communication may be inone of a variety of modalities, such as Bluetooth, ultra-wideband,radiofrequency, etc. Based upon the signal, Smart Device 901 maytransmit to a server, a database query based upon a determined set ofcoordinates of transmitter 922.

If the database contains an entry comprising, as a data structure, a setof coordinates proximate to the set of coordinates of transmitter 922,then Smart Device display 902 may display icon 912 proximate to thelocation of transmitter 922, as displayed on Smart Device display 902,or otherwise on the virtual representation of the shop 911. In this way,a user of Smart Device 901 may be alerted to the presence of informationassociated with structure 921 in which the user may be interested.

In some embodiments, icon 912 may be displayed on Smart Device display902 only if Smart Device 901 can transmit appropriate permissions to thedatabase. For example, icon 912 may only display if Smart Device 901 ison a certain Wi-Fi network or if the user of Smart Device 901 has inputthe appropriate credentials. In other embodiments, icon 912 may displayon any Smart Device display 902 (if the Radio Target Area Cone 913includes transmitter 922), but further functionality may be based uponinputting a password (or, in some embodiments, correctly input theanswer to a question).

In some embodiments, the appearance of icon 912 may change based upon anidentity of the user or based upon some other dynamic. For example, ifthe user has a certain UUID, and the database includes a messagespecifically intended for a user with that UUID, then the icon may flashto indicate the presence of a message. This message may be displayedtextually, visually, audibly, or by a hologram. Similarly, the databasemay record each instance in which it is accessed by a query from a SmartDevice. Such a record may include a time stamp. If data related tostructure 921 has changed since the last time stamp, then icon 912 mayturn red (for example) to indicate such a change. In addition, digitalcontent may be appended to any content already in the database, such asadditional alphanumeric annotation, an audio file, an image file, avideo file or a story file.

Activation of an interactive user device encompassing icon 912,additional functionality may be provided to the user of the Smart Device901. For example, selecting icon 912 may display information aboutStructure 921, such as shop hours or discounts. Alternatively,activating the interactive user device associated with icon 912 maygenerate a control panel, which may allow the user to control aspectsrelating to sensors or other electronics within structure 921. Forexample, upon confirmation that Smart Device 901 has the appropriatepermissions, selecting icon 912 may allow the user to turn off thelights within structure 921.

The Smart Device 901 may also display other functional buttons on itsdisplay 902. In some examples, one such function may be to show displaysof the sensor RTA 913 in the context of the universal Radio Target Areasurrounding the user. By activating the functional button, the user maybe presented with a set of options to display the universal Radio TargetArea.

Referring to illustration FIG. 9B, an example of a means of illustratinga RTA 970 is provided. The display screen of the Smart Device 901 maydisplay a number of information components. A similar illustration asFIG. 8G may be included as inset 975. However, a different illustrationof the RTA 970 may be formed by flattening the surface of theillustrated sphere into a flat depiction where each of the surfaceregions may be flattened into a segment 971. The RTA 970 may beillustrated on the flat segments. A Tag or icon 912 may be locatedwithin the device RTA 970 showing structure 911. The icon 912 may alsobe included in the real time display of a representation of datagenerated by an energy-receiving Sensor. Tags may also be locatedoutside of the RTA 970. An Agent may move around the Smart Device tolocate an RTA that encompasses Tag 974.

Referring to FIG. 9C, item 980, an exemplary display screen 990 forSmart Device 901 that may be displayed when a user activates a Tag at alocation outside the RTA 982 is illustrated. When the user activates theexemplary Tag 981, a menu 985 may display. Amongst the variousinformation such as text, imagery, video content and the like that maybe displayed an identification of the Tag 986, associated textualinformation and data 987 as well as functional buttons 989 may bedisplayed on the user interface and may be used by the user to activateadditional function including new display layers, content integrationand control function such as in a non-limiting sense a control to revertto a previous menu display.

In some examples, a Smart Device may function as a Tag. The Tagfunctionality may include providing location-related information asbroadcasted digital content. In providing such broadcasted digitalcontent, the Smart Device tab may employ numerous forms of securityprotocols for the protection of the information and authorization of itsuse which may include sign-in/password protocols, sharing of encryptionkeys and the like. In similar methods, a central server may providecontent related to a Tag and may manage security protocols and the likewhere a Smart Device acting as a Tag may merely share an identificationphrase that a user could use with applications running or connectingwith the central server could use to be authorized for additionalcontent. Location may be determined by the various means as describedherein including wireless communication with position Nodes by GPS,Cellular, Wi-Fi, Ultrawideband, Bluetooth and the like. If the SmartDevice is operating in a mesh Node, the mesh could communicate withinNodes relative and absolute location information which the Smart Devicemay share as its role as a Tag. In addition to location, other sensordata at the Smart Device such as temperature, vibration, sensor imagery,LiDAR scan imagery, sound sensing.

In addition to real-world data, the Smart Device Tag may also providevirtual content associated with itself and its connected environment.The Smart Device may provide content stored within its memory devicesand may provide dynamically calculated results of processing on contentstored in its memory devices. The virtual content may also correspond toa user interface of the Smart Device Tag that may be used to initiate orauthorize function of the Smart Device including real-world activitiessuch a communication via internet protocol, text, phone, or video.

In some embodiments, an energy-receiving Sensor may receive energyassociated with a LiDAR transmission and/or other functionality involvedin LiDAR scanning which can be used to interrogate the local environmentfor physical shapes. In a Smart Device Tag function, the Smart Devicemay stream its video and scanning data directly or through a servermodel. Some Smart Devices may be configured to operate as a smartsecurity monitoring systems and may provide the video, topographic,audio, and other sensor streams as Tag related content. There may benumerous manners that a Smart Device could function as a Tag in anenvironment.

A Smart Device with either a single- or multiple-sensor system may alsohave a LiDAR scanning capability or other three-dimensional scanningcapability. The Smart Device may utilize a number of systems to refineand improve its accuracy in determining the location that it is at. Inan example, a Smart Device may utilize a GPS or cellular system to getan approximate location of the device. In a next step, a user mayinitiate the Smart Device to take a series of image and scanning dataacquisitions of its environment. For example, the user may move thephone by hand to different directions while maintaining their feet in afixed location. The phone may use one of the orientation methods as havebeen discussed to determine its orientation as it is moved to differentvantage points. The Smart Device may either process those images andcompare against a database in its memory, or it may communicate the datato a server to do the comparison. With an approximate location, theorientation information, and the streams of video and/or topographicinformation, a calculation may be performed to match theimage/topographic information to a more exact positional location. Inalternative examples, the device may use the image and/or topographicinformation to determine the orientation of the device itself.

In some examples, the Smart Device may act as a receiver of one ormultiple types of wireless energy input. For example, the acquisition ofdata based upon a visual light spectrum (approximately 380 to 700 nmwavelength) may be modelled as spatially-characterized electromagneticenergy. Electromagnetic energy in the visible band may enter a focusinglens and be focused up an array of devices. The devices may beCMOS-active pixel sensors, CMOS back-illuminated sensors, or CCDs, asnon-limiting examples, to receive the energy and convert it intospatially-arrayed pixel data.

In some examples, the Smart Device may have an energy-receiving Sensorincorporated or attached which may quantify energy levels forfrequencies outside the visible spectrum. Any optics employed in suchsensors may be different from the previously discussed CMOS and CCDSensors since some of those energy receiving devices may have filters orlenses that absorb wavelengths outside of the visible spectrum. Sensorswith infrared capabilities may have specialized optics and may usedifferent materials for the CMOS and CCD elements—such as indium galliumarsenide-based sensors for wavelengths in the regime of 0.7-2.5 μm.

Alternatively, entirely different sensing elements, such as bolometers,which sense temperature differences of the incoming radiation, may beemployed for longer wavelengths in the regime of 7-14 μm and may includefilters that remove other wavelengths. A display of an infrared Sensor,which senses incoming energy in the infrared band, may be rendered on atypical visual display, but the colors of such displays may have nodirect physical meaning. Instead, a color scheme may be instituted torepresent different infrared wavelengths with different visible colors.Alternatively, the colors may be used to represent different intensitiesof infrared energy received across bands of infrared wavelengths.

In some examples, a Smart Device may both project and receive energy.For example, a Smart Device may scan the topography of its surroundingsby use of LiDAR. In LiDAR a laser may be used to emit energy into theenvironment. The energy may be emitted as pulses or continuous trains,and the light source may be scanned across the environment. Lightemitted from the Smart Device may proceed into the environment until itis absorbed or reflected. When it is reflected and subsequently receivedat the Sensor, the transit time can be converted to distancemeasurements of the environment. Many different wavelengths of light maybe used to scan an environment, but numerous factors may favor certainchoices such as invisibility to human/animal eyes, safety, absorption bythe airspace surrounding the user and the like. Atmospheric gases mayabsorb significant amounts of infrared transmissions at certainfrequencies; therefore, for LiDAR to be effective in the infraredspectral region, certain bands of emitted frequencies may be favored. Astandard LiDAR system may operate at a band from 900-1100 nm infraredwavelength or at a band centered at approximately 1550 nm. As discussedpreviously, select optic components and materials may be useful forthese wavelengths and the detectors may have improved function based onmaterials such as “black” silicon, germanium, indium phosphide, galliumarsenide, and indium gallium arsenide as exemplary detector materials.

In an example, a laser light source may be rastered across a dimensionof forward looking positions of a Smart Device, which may be representedby a conic section or Radio Target Area in front of the Smart Device. Asthe light is raster across the surface it can address, it may be pulsedon or off. As the light travels out along a collimated path, it mayinteract with a surface and a portion of the intensity may be reflectedbackwards.

A resulting reflected ray may come back to the Smart Device and bereceived by a Sensor in the device. Since the emitted light source maybe orders of magnitude more intense than the surroundings, reflectedlight may dominate a background intensity and the signal detected may becompared with the time of the leading edge of the laser pulse. Therepeated acquisition of the timing signals in the various directions canbe used to form a point cloud that represents the distance to reflectivefeatures from the Smart Device.

As mentioned previously sound may be reflected off of surfaces and thetransit time may be used to characterize a distance between a focusedultrasonic transducer and a reflective surface. In similar manners,points or lines of focused sound emissions may be pulsed at theenvironment and a sensor or array of sensors may detect the reflectedsignals and feed the result to a controller which may calculate pointcloud representation or other or topographic line representations of themeasured surface topography. In some examples, ultrasonic focused andscanned soundwaves in the frequency range of hundreds of megahertz mayresult in small focused sources whose reflections may be detected bymagnetic or piezoelectric sound transducers as non-limiting examples.

A Smart Device may have numerous different types of energy-collectiondevices which may characterize data values with spatial relevance. Asmentioned before, infrared imaging may be performed on some SmartDevices, and a user may desire to view a spatial representation of theinfrared imaging that represents the data as it may appear if the user'seyes could perceive the energy. In some examples, data values for thewireless energy sensing of infrared energy may be assigned color valuesand displayed in an image format. For examples, low levels of infraredenergy, which may relate to colder temperatures in the imaged regions,may be assigned blue color values, and high levels of infrared energy,which may relate to warmer temperatures, may be assigned red colorvalues. Other color assignments to data values may be used. A legend forthe conversion of the color values to the data values may be provided.

In some examples, the data descriptive of spatially descriptive energylevels quantified by an energy-receiving Sensor data may be portrayed ina user interface. In some user interfaces, representations based uponspatially representative energy levels of different wavelengths may beaggregated or otherwise combined in one or more related user interfaces.Such a combination may allow a user to understand the regional nature ofvarious quantified energy.

In some examples, a user interface may allow for display of thepositional location image points. In some examples, a location of apixel element chosen by a user may be converted to a real-world locationwithin the RTA which may be represented in Cartesian coordinates (X,Y,Z)or in other coordinate systems such as polar coordinate systemsinvolving angles and distances as discussed previously. In someexamples, topographic data obtained by scanning an area with a RTA maybe used quantify topography within the RTA. A user interface based uponsuch quantified energy levels may include virtual presentations of thequantified energy levels from different perspectives and may allow forcoordinate grids (Cartesian or other) to coordinate placement of facetsof a user interface based upon combinations of energy level data, Taglocations and perspective relevance.

In some examples, distinct structures within the RTA may be highlightedand assigned positional coordinates. In some examples, this may occur byimage processing directly, in other examples a user interface may allowfor a user to pick items/regions of interest in a RTA presentation.

In other examples, real and virtual Tags may exist within the RTA. Aphysical Tag may include a position Node, another Smart Device, or anydevice with communication capability that can communicate with either aposition Node or with the Smart Device of the user directly. Suchphysical Tags may be located in numerous manners. In some examples, thephysical Tag may have a direct determination of its location eitherbecause it is stationary and has been programmed with its location orbecause it has the capability of determining its own position with thevarious methods as have been described herein. In other examples, aphysical Tag may be able to communicate with Nodes such as ReferencePoint Transceivers and a location may be determined based upon anexchange of data, such as timing values, in the wireless communications.A Node may also be functional to determine, store and communicate alocation of other Tags. The Smart Device of the user may gain access tothe locations of Tags, either because they are publicly available orbecause the user has established rights digitally to obtain theinformation from some or all of these physical Tags.

There may also be virtual Tags that are associated with positionalcoordinates. The distinction of these Tags over physical Tags is thatthere may be no physical presence to the virtual Tag. It may be adigital or virtual-world entity that has an association with areal-world positional coordinate. Except for this distinction, a virtualTag and a real-world Tag may behave similarly with respect to theirassociation with a physical coordinate.

In these examples, an interactive user interface based upon energylevels and Tags located with a RTA may have icons associated with theplacement of Tags. The user interface may include an icon positionaldesignation and a graphic to indicate the presence of a Tag. It may beapparent that, in some cases, multiple Tags may lay along a singledirection from a given Smart Device location and RTA, and thus multipleicons may be included within a user interface in close proximity. Theuser interface may indicate multiple Tag icons by color changes,blinking or other indicators. As a RTA is changed, Tags along a sameperspective may resolve into different directions for Tags withdifferent positional coordinates.

The Tag icon may indicate to the user a digital functionality associatedwith a real-world or virtual Tag. For example, the icon may allow a userto choose the functionality of the icon by moving a cursor over the iconand making a keystroke or mouse click or for touch screens by pressingthe display location of the Tag icon. The choosing of the Tag icon mayactivate user interface dialogs to allow the user to control subsequentfunctionality. In cases of superimposed Tag icons on a same pixellocation in a user display, a first functionality may allow the user tochoose one of the multiple Tag icons to interact with. In some examples,a Tag icon may be displayed with an associated ID/name and a user mayselect the icon with voice commands rather than physically selecting theicon as described previously. Displays of these Tags may follow similarprotocols as have been discussed in reference to FIGS. 9A-9D.

Referring now to FIG. 10A, a method for generating an augmented-realityRadio Target Area for a Smart Device is shown. At step 1001, wirelessenergy of a first wavelength is received into a wireless receiver. Inexemplary embodiments, this step may include receiving image data basedon visible light into a sensor of the Smart Device. The wireless energymay be dispersed over a one-, two-, or three-dimensional space in adefined physical area, and may be received into a one-, two-, orthree-dimensional array in the receiver. The wireless energy may takethe form of electromagnetic radiation, such as light in thehuman-visible light spectrum (generally having a wavelength between 380nm-740 nm), ultraviolet light (generally having a wavelength between10.0 nm-400 nm), or infrared light (generally having a wavelengthbetween 740 nm-2.00 mm) as examples. The set of wireless energyavailable to the wireless receiver is the Smart Device's Radio TargetArea.

The wireless receiver may be a Smart Device sensor, including a CMOSactive pixel sensor, a CMOS back illuminated sensors, CCD, or a LIDARapparatus, including a solid-state/MEMS-based LIDAR. The wirelessreceiver may comprise an array or other plurality of other wirelessreceivers. The wireless receiver may be operative to receive thewireless energy into an array of an appropriate dimension for subsequentdisplay (possibly after processing) on the Smart Device. For example,where the wireless receiver is a Sensor, the Sensor may be operative totranslate the wireless energy into a two-dimensional array.

At step 1002, a pattern of digital values is generated based uponreceipt of wireless energy into the wireless receiver. This pattern ofdigital values may be based on one or more qualities of the receivedwireless energy, including its intensity, spatial dispersion,wavelength, or angle of arrival. The pattern may be placed into anappropriate array. For example, if the display of the Smart Device is atwo-dimensional display, then the pattern of digital values may comprisea two-dimensional representation of the image data received. In someembodiments, the pattern of digital values may be based on an aggregatedset of values from an array of receivers. For example, if the basis ofthe digital values is the intensity of the wireless energy received intothe receiver, then the digital value assigned to a given entry in thearray may be based on a weighted average of intensity of wireless energyreceived at a plurality of the receivers in the array. Optionally, atstep 1003, the wireless receiver may receive the wireless energy as ananalog signal (for example, if the wireless receiver is ablack-and-white sensor or an unfiltered CCD), and convert the analogsignal to digital values through filtration or other analog-to-digitalconversion. The set of digital values within the Radio Target Area isthe Digital Radio Target Area.

With the Smart Device wireless receiver's Radio Target Area determined,the Smart Device's position should be determined as well, along with thepositions of any items of interest in a given space. Collectively, theSmart Device and the item of interest may comprise wireless Nodes.Accordingly, at step 1004, coordinates representative of a wireless Nodemay be determined relative to a base Node. These coordinates may bedetermined in any appropriate coordinate system (such as Cartesian,polar, spherical polar, or cylindrical polar) and may be determined viaRTLS or the orienteering-triangulation methods with various wavelengthsor modalities, such as ultra-wideband, Bluetooth, etc. Additionally, thecoordinates may be determined using an angle of arrival or angle ofdeparture of a signal to or from the base Node, along with the distancefrom the base Node. By way of non-limiting example, this could produce adataset that correlates the coordinates of three elements with theidentities of those elements: {(0,0,0), BaseNode; (1,1,1), SmartDevice;(2,2,2), ItemOfInterest}. While this example may be used throughout thefollowing discussion, it is understood to be non-limiting, as a givenspace may include a plurality of items of interest. Note that, in someembodiments, the Smart Device itself may become a dynamic database entrywith a continuously (or periodically) updating set of coordinates. Thismay be useful in allowing a plurality of Smart Devices engaged with thesystem at the same time to interact with one another.

At step 1005, the position of the Base Node is determined relative tothe defined physical area. In exemplary embodiments, this may includeestablishing the Base Node as an origin in the coordinate system anddetermining vectors from the Base Node to boundaries and items ofinterest (i.e., the distance from the Base Node and the direction fromthe Base Node to the boundaries and items of interest). In someexamples, the Base Node may have an established reference relative to aglobal coordinate system established.

At step 1006, a Target Area is generated within a controller of theSmart Device. The Target Area may be the set of coordinates (relative tothe Base Node) within the Radio Target Area of the wireless receiver.The Target Area may be limited by physical boundaries of the givenspace, such as walls, floors, ceilings, occlusions, etc. The Target Areamay also be limited by distances that various types of signals maytravel. For example, a sensor of audio signals may not be able topractically pickup signals over a background noise level that originatemore than 1000 feet from a user position, purely as an example. In sucha case, the Target Area for such signal types may be limited to thatdimension.

At step 1007, respective positions of one or more wireless Nodes withinthe Target Area are determined. These positions may be determinedrelative to the physical Target Area or the Radio Target Area. Thedetermination may be made with reference to the dataset discussed atstep 1005, or it may be made dynamically based upon one or more BaseNodes and/or the Radio Target Area. Moreover, the determination mayadditionally be based on receipt of a wireless signal into the SmartDevice from the wireless Node. This signal may indicate a position usingthe orienteering methods described herein.

At step 1008, a user interface may be generated on the Smart Devicebased upon the pattern of digital values generated at step 1002. Theuser interface may comprise a plurality of pixels, wherein each pixelcomprises a visible color based upon the pattern of digital valuesgenerated at step 1002. For example, if the digital values were basedupon receipt of visible light into the wireless receiver (e.g., asensor), then the display may reflect a reasonably accurate colorphotograph of the Radio Target Area of the wireless receiver. If thedigital values were based upon an intensity of received light from, forexample, LIDAR, then the display may reflect a scan of the Radio TargetArea. In some embodiments, the pixel may include an intensity of energyreceived into the receiver. In this way, aspects of the Radio TargetArea characterized by an intensity of energy may be emphasized. Forexample, this may produce a LIDAR relief of an area or a heatmap of anarea.

At step 1009, an icon may be generated in the user interface. Preferablythe icon will be placed at a position relative to data quantifyingreceived energy levels. In some embodiments, the icon location in a userinterface will be indicative of a position of a Tag (Virtual orPhysical). This position may be quantified via positional coordinates,such as Cartesian Coordinates, Polar Coordinates, Spherical Coordinatesand the like. The icon may be based upon an input from a user, storeddata, quantified environmental conditions or other criteria related toan aspect of the Radio Target Area.

For example, an icon may indicate information about an Item of Interestlocated at a given set of coordinates within the Radio Target Area orDigital Radio Target Area. In another embodiment, the user may indicateon the display a position in which the user wishes to place an icon andadd information about an Item of Interest (thus creating a new entry inthe database, which may be populated with the coordinates of theindicated position). Moreover, the icon may change colors based upon thepattern of digital values. The icon may be overlaid on top of thedisplay. The icon may resemble the letter “i”, a question mark, athumbnail, or any other suitable image from a library. In someembodiments, the icon may change depending on one or more attributes ofits corresponding database entry. For example, if the icon located at(4,4,4) relates to a restaurant menu, then the icon may resemble theletter “i” or a thumbnail of a menu. On the other hand, if this databaseentry is modified so that the corresponding database entry is a message,then the icon may update to a picture of an envelope.

In some embodiments, the icon-generation step may be based upon aninquiry to a database that uses the Digital Radio Target Area as aninput. For example, upon generation of the Digital Radio Target Area, anassociated set of coordinates in one or more dimensions may begenerated. This may then be submitted to a database. An associateddisplay may be as illustrated in FIG. 9A. In some embodiments, theicon-generation step may be based upon an inquiry to a database thatuses the user's position coordinates as an input. In these embodiments,both the Digital Radio Target Area based on a RTA as well as theuniversal Radio Target Area may be included in an inquiry submitted tothe database. An associated display may be as illustrated in FIG. 9C. Insome examples, the user may have an option to limit or filter the typesof database entries that may be queried for, such as in a non-limitingsense, the existence of real-world Tags, virtual Tags, sensor datavalues and streams from a particular class of sensors and the like.

Continuing with the example from step 1004, the Digital Radio TargetArea may comprise the set of coordinates: ([1.5,10], [1.5,10],[1.5,10]). In this example, the database may return information aboutthe Item of Interest, but not about the Base Node. The Digital RadioTarget Area may update when the Smart Device position changes, or byuser input, the Digital Radio Target Area may remain static after acertain instance in time.

Continuing with FIG. 10B, at step 1010, the icon may be positioned inthe user interface at a given position based upon coordinatesrepresentative of the position of the wireless Node or Tag in the TargetArea. This may comprise a selection of a multitude of pixels related tothe position of the wireless Node or Tag, and changing those pixels fromthe digital values determined at step 1002 to a second set of pixels toindicate the presence of an icon. In some embodiments, the icon may bedynamically updated based upon movement of the Smart Device (and,accordingly, the wireless receiver). In some embodiments, the icon maybe permanently associated with a set of coordinates. In suchembodiments, the icon may be generated whenever a Smart Device withappropriate permissions includes in its Radio Target Area the set ofcoordinates of Nodes or Tags associated with the icon.

At step 1011, user-interactive functionality may be associated with thepixels comprising the icon. This may allow the user to “select” the iconby means of an input device (e.g., mouse, touchpad, keyboard),touchscreen, digital input, etc. Upon selection, the icon may beoperative to interact with the user in one or more ways, including:displaying a message intended for the user (by text, audio, video,hologram, etc.); requesting credentials from the user to verifypermissions (e.g., a password), displaying information about an itemassociated with the icon, prompting the user to update information aboutan item associated with the icon, etc. The user-interactivefunctionality may display static information (e.g., dimensions of theitem), display dynamic information (e.g., an alarm state or sensorinformation relating to the item; for example, if the item is arefrigerator, internal temperature may be displayed), or produce acontrol panel that allows the user to issue control commands (e.g.,remotely operating an automated apparatus by resetting an alarm state,taking remedial action based upon a sensor state as described herein,etc.) or to issue menu control commands such as to invoke a differentuser interface or screen of a user interface.

This may be useful in geospatial applications, or in procedurallygenerated activities. For example, a first user may generate apositional designation on a user interactive device, such as, forexample an augmented-reality display to leave a narrative, icon or otherinput associated with the first use. Additionally, the same or anotheruser may log positional coordinates and upload an image that could bedisplayed submitting a database query including those coordinates. Entryof the coordinates and essential credentials may provide access to thecontent associated with the positional coordinates.

At step 1012, the preceding steps may be integrated by generating adisplay comprising the user interface, the icon, and at least some ofthe associated user-interactive functionality. In embodiments, in whicha plurality of Smart Devices are themselves part of the database, thismay allow various users to send messages, images, etc. to each other.

At step 1013, detection of movement of the Smart device may cause abranch back to step 1005. Based upon that movement of the Smart Device,a defined physical area from which wireless energy is received (i.e.,the Radio Target Area based upon the Target Area) may be changed. Themovement may be detected using input from wireless communications,magnetic field sensors, an accelerometer, feature-recognition software,or other similar apparatus and algorithms. In other examples, theposition of the Smart Device may be dynamically obtained using any ofthe techniques of position determination, such as triangulation withreference nodes. Here, too, a change of position detected in this mannermay cause a branch back to step 1005. The Target Area may be based uponthe position of the Base Node, the relative positions of the wirelessNodes, and the Smart Device.

Referring now to FIG. 11, an exemplary database structure usable inconjunction with the present disclosure is shown. In this non-limitingexample, the database has five sets of information: coordinates 1101associated with an action, permissions 1102 associated with the action,the type 1103 of action, attributes 1104 for the action, and notes 1105.The example shown in FIG. 11 may suppose the following: theaugmented-reality system is deployed in an enclosed space, definable bya coordinate system set relative to a Base Node having an origin point(0,0,0); the enclosed space spans, in that coordinate system, ([0, 10],[0, 10], [0, 10]) (using traditional set notation; in other words, eachcoordinate can take on any number between 0 and 10, inclusive); and theRadio Target Area is ([1, 10], [1, 10], [1,10]).

The bolded entries in the database shown in FIG. 11 represent thedatabase responses to the query given by the Radio Target Area of theSmart Device; i.e., all entries having a Coordinate value within theRadio Target Area. In some embodiments, the database may sort throughall coordinates within the Radio Target Area and then return any entriesfor which the Smart Device has appropriate permissions. In otherembodiments, the database may sort through all entries for which theSmart Device has appropriate permissions and then return any entrieswith coordinates within the Radio Target Area. The latter approach maybe beneficial in circumstances in which there are numerous databaseentries with varying permissions; for example, if a database has10,000,000 entries, but a given user might only have access to five ofthose entries, sorting by permissions first may be more beneficial.

The ActionType variable may include any action for which interactivitywith an icon may be desirable. In FIG. 11, the ActionType variablesshown are Information, Message, Action, and Directions. Each of theserepresents functionalities within the scope of this disclosure. Forexample, Information may relate to information that the Smart Deviceuser may find helpful. Continuing with the shop example from FIG. 9A,Information may include store hours, discounts, reviews, etc. Similarly,Message may be a message to the general public (e.g., an announcement),or a message tailored to a specific user. In the latter case,permissions may operate to ensure that only the specific user (or set ofusers) may access the Message.

Action may relate to any action that a sensor, electronic device, orother apparatus connected to the database may take. For example, Actionmay include changing a temperature, measuring a temperature, turning offlights, activating an emergency sprinkler system, opening a door, etc.In some embodiments, prior to taking the Action, a password may berequested as part of the permission check.

Directions may show a user how to navigate (using, in exemplaryembodiments, orienteering methods) from the current position to adesired position. For example, upon scanning an entry on a map, virtualarrows may be generated to guide the user to a chosen store.

The ActionAttributes may have attributes based on the ActionType. Forexample, if the ActionType is Information or Message, then theActionAttributes may be a text string or a stored audiovisual filecontaining the message. Similarly, if the ActionType requires a sensoror other electronic device to take an Action, then the ActionAttributesmay include a command or subroutine to effect such an Action. In theexample shown here, the ActionType Directions comprises anActionAttribute that includes a command to the Smart Device (i.e., showdirections in the form of green arrows).

Referring to FIG. 12, an illustration of alternative methods for displayof information relating to RTA is provided. At the beginning of theprocess, a system of components which may include a smart device with auser of the smart device may be established. Amongst the variouscomponents a Home Position may be established for all the components atstep 1201. The system may proceed by establishing and initiatingtransceiving of data and information at step 1202.

In some examples, the user may be prompted to choose a desiredcoordinate system for the display at step 1203. In other examples, auser interface of the system may have a setpoint function which the usermay invoke to gain access to user settable parameters which may includethey type of coordinate system to use, such as for example Cartesian orspherical coordinates.

In still further examples, the system may decide to default to aparticular coordinate system depending on the nature of the type of dataits positional reference devices may be obtaining or providing.

At step 1204, if the coordinate system was chosen as Cartesiancoordinates, the system may utilize triangulation amongst multiplereference point transceivers. Alternatively, at step 1205 if thecoordinate system was chosen as polar coordinates, the system mayutilizes positioning systems that utilize angles and distances involvedin transceiving and location. In either event, at step 1206, theposition of a Sensor attached to the smart device of the user may bedetermined. In some examples, the system may have multiple and redundantlocation system. A combination of such position determinations mayresult in superior accuracy of an aggregated position result.Accordingly, at optional step 1207, a wireless position determinationmay be performed with the smart device to establish a verification ofthe position of the Smart Device and the Sensor attached. Referring nowto step 1208, a direction that the sensor is facing in may bedetermined. Although there may be a number of different manners ofdetermining orientation as have been described herein, in an example,the orientation may be determined based upon wireless transmissionand/or wireless verification.

Referring now to step 1209, an energy-receiving Sensor included in theSmart Device or in logical communication with the Smart Device may beused to quantify energy levels perceivable at the position and in thedirection of the Smart Device. The resulting quantification may dependon aspects of the Sensor device, but the resulting data will quantify acharacteristic for the RTA.

In some embodiments, an optional step 1210 may be performed by anelement of the system such as the smart device or a server incommunication with the Smart Device. The element of the system maycompare one or more of position information, orientation information andthe image data itself to calculate an estimate of whether the RTA anglehas changed for the sensing element.

In general, at step 1211, the RTA of the Sensor device used to capturethe image in step 1209 may be quantified. In an optional step 1212,coordinates relating to the instant RTA of the image may be established.In some examples, this may relate to a range of three-dimensionalcoordinates that are addressed by the RTA of the Sensor element. Ingeneral, at step 1213, the system may look up, or in some casesgenerate, location coordinates for Tags that are determined to be withinthe quantified RTA. In some database systems that the system may haveaccess to, real-world or virtual-world tags may be tracked in acoordinate system with a certain origin.

If the current origin established at step 1201 is offset from aparticular database related origin, then one or both the coordinatesystem values may be converted to each other to align their respectiveorigins. At step 1214, the Tags in an aligned coordinate system may havetheir positions compared to the current RTA and a selection for the setof Tags that are within the RTA may be made.

In some alternative examples, a display of all Tags that are authorizedfor access to the user regardless of whether they are in the RTA may bemade using associated aligned coordinates as discussed in reference tostep 1213.

Referring now to step 1215, in an example, the Smart Device of the usermay be used to generate and display a user interface to the user basedupon the captured image and the associated tag icons within the RTA.These associated Tag icons may have at least the functionality as hasbeen discussed in reference to FIGS. 10A and 10B.

Referring now to FIG. 13, a Smart Device 1301 is illustrated within aWCA 1302. The extent of the particular WCA 1302 may be defined accordingto a select bandwidth and/or a particular modality of the wirelesscommunication the Smart Device 1301 uses to transmit and receiveinformation.

For example, bandwidths may include those associated with UWB, Wi-Fi,Bluetooth, ANT, ultrasonic, infrared and cellular modalities ofcommunication. In general, unless otherwise constrained by physicalmodification such as the use of a directional antenna, or the presenceof radio frequency interference from a physical object (such as objectswith significant metallic content; objects with high water content;electrical fields; etc.), a WCA 1302 may include spherical area(s)emanating from one or more transceivers and/or transceiver antennasoperated by the Smart Device 1301.

As discussed extensively herein, and in patent applications referencedby this application, the location of the Smart Device may be determinedbased upon wireless communication to and/or from the Smart Device 1301;and described via a coordinate system, such as via generation ofCartesian coordinates, or other coordinates such as: polar coordinates,spherical coordinates, and cylindrical coordinates. Modalities ofwireless communications that may be referenced to generate locationcoordinates may include one or more of: RTT (round trip time), time offlight, RSSI (received signal strength indicator); angle of arrival,angle of departure, and other methods, equipment and modalities as havebeen described herein.

With the location of the Smart Device 1301 determined, a location of theWCA 1302 may be extrapolated based upon the location of the Smart Deviceand a range or transceiving distance the Smart Device may be capable of.

According to the present invention, a portion of the WCA 1302 may beselected as a radio target area (RTA) 1312 from which the Smart Device1301 may receive specific bandwidths of electromagnetic radiation. Inpreferred embodiments, the RTA 1312 may include a frustum expandingoutward in a conical shape from one or more energy receivers 1309included in the Smart Device 1301. The frustum shaped RTA 1312 mayoverlap with a portion of the generally spherically shaped WCA 1302.Other shapes for a radio target area 1302 are also within the scope ofthis specification.

In some embodiments, a shape of the RTA 1312 may be based upon receivingcapabilities of the one or more energy-receiving Sensors 1309incorporated into or in logical communication with the Smart Device. Forexample, an energy-receiving Sensors 1309 with a charge coupled device(CCD) or complementary metal oxide semiconductor (CMOS) receiver mayhave a single plane receiving surface and be best matched with a frustumof a generally pyramidal or conical shape. Whereas, an energy receiver1309 with multiple receiving surfaces (e.g. with multiple CCD and/orCMOS devices) may be arranged to enable a more complex shaped RTA 1312.

In some preferred embodiments, a direction of interest 1311 mayintersect the RTA 1312. As discussed herein, the direction of interest1312 may be represented by a ray or vector 1311. In addition, thedirection of interest may be represented as a direction of interestarea, such as a frustum defined by multiple rays or vectors 1311, 1311A,and 1311B. In various embodiments, the direction of interest 1311 areamay encompass the RTA 1312 or be a subset of the RTA 1312.

A direction of interest may be determined for example via the methodsand devices described herein and in referenced patent applications andmay be associated with a direction based upon a ray or vector indicativeof a direction of interest 1311, a direction based upon a magnetic fieldsensor, an accelerometer, a light beam, correlation between two Tags orNodes, Agent gestures, or other Smart Device recognized apparatus and/ormethod.

One or more transceivers 1303-1305 (typically included within a SmartDevice, Tag, or Node) may be located within an area defined by the RTA1312. According to the present disclosure, a position of the transceiver1303-1305 may be determined and a user interactive mechanism may begenerated at a position of the transceiver 1303-1305 within a graphicaluser interface emulating aspects of the RTA 1312 on the Smart Device1301 or another user interactive interface screen (not shown, andperhaps at a site remote to the RTA 1312).

According to the present disclosure, some portion of the RTA 1312 (whichmay include the entirety of the RTA 1312) may be portrayed on an Agentinterface 1310, including, in some embodiments, a human-readablegraphical user interface (GUI). The interface 1310 may include arepresentation 1313 of a particular level of electromagnetic energyreceived via the energy receiver 1309 and associated with a particulararea of the RTA 1312. For example, energy levels of an infraredwavelength that has emanated from or reflected off of an item in the WTA1312 and received via an infrared receiver in the Smart Device 1312 maybe used to generate a heat map type interface display. Similarly, energythat has emanated from or reflected off of an item in the RTA 1312 inthe 400 nm to 700 nm range and been received via a charge-coupled/orCMOS image sensing device in the Smart Device 1301 may be portrayed as ahuman visible image of items in the area included in the RTA 1312.

Other embodiments may include a point cloud derived from electromagneticenergy bouncing off of or emanating from items included in the RTA 1312or a series of polygons generated based upon a LIDAR receiver in theSmart Device 1312. An Agent interface 1310 may be presented in amodality understandable to an Agent type. For example, an interfacepresented to a UAV or UGV may include a digital pattern and an interfacepresented to a human Agent may include multiple pixels or voxelsgenerating a pattern visible to a human being.

The wireless location methods and apparatus described herein may bedeployed in conjunction with one or more Transceivers 1303-1305 or Tagsand/or Nodes 1306-1308 located with the WCA 1302 to generate locationcoordinates for the one or more Transceivers 1303-1305 or Tags and/orNodes 1306-1308. A controller or other device operating a processor maydetermine which one or more Transceivers 1303-1305 or Tags and/or Nodes1306-1308 located within the three-dimensional space included in the RTA1312 based upon a) the location of the one or more Transceivers1303-1305 or Tags and/or Nodes 1306-1308; and b) the location of areaincluded in the RTA 1312.

In another aspect of the present disclosure, in some embodiments, someenergy levels may not be represented in the Agent interface 1310. Forexample, in some embodiments, energy levels reflected off of aparticular item may not be included in the Agent interface 1310. Otherembodiments may only represent energy levels that have reflected off ofselected items within the RTA 1312 thereby emphasizing the presence ofthe selected items and ignoring the presence of other items within theRTA 1312.

As described above, some portion of the RTA 1312 may be portrayed on anAgent interface 1310, including, in some embodiments, a human readablegraphical user interface (GUI), as a point cloud derived fromelectromagnetic energy bouncing off of or emanating from items includedin the RTA 1312 or a series of polygons generated based upon a LIDARreceiver in the Smart Device 1312. An example of such a representationis shown in FIG. 14. In this example, the GUI includes a human visualimage 1401 of an RTA 1400 overlaid with a series of polygons 1402generated based upon a LIDAR receiver in the Smart Device. The LIDARsensor illuminates the RTA 1400 with laser light and then measures thereflection with a sensor. The resulting polygons 1402 representdifferences in laser return times, which provides a topographicalrepresentation of objects in the RTA

In this example, Virtual Tags 1403 and 1404 are created by the SmartDevice by methods described herein and icons may be present on the GUIto identify the position of the Virtual Tags 1403 and 1404. The VirtualTags 1403 and 1404 may, for example, represent various locations ofinterest in the RTA, such as an object of interest (1403) or an exit orentrance (1404). The icons associated with the Virtual Tags 1403 and1404 may be engaged or “clicked” or otherwise activated to be madeoperational; for the Smart Device to receive (e.g., retrieved from adatabase) additional information associated with the object or locationof interest.

For example, if the object of interest is a statue, clicking on the iconassociated with the Virtual Tag 1403 associated therewith may provideinformation regarding the statue, such as the history, origin, and thelike. If, for example, the Virtual Tag 1404 is associated with an exitof the room, clicking the Virtual Tag may provide information on what ispresent in the adjacent room, or where the Smart Device is in relationto exiting the building, or any other desired information.

In some embodiments, mathematical data associated with a LIDARrendering, such as parameters of triangles formed by various LIDARpoints 1405-1406 within an associated RTA may be stored and a relativeposition of a smart device with the RTA 1400 may be determined basedupon the recognition of similarities of the LIDAR point 1405-1406patterns. A resolution of laser scanning involved in generation of databased upon LIDAR techniques may influence a number of date points withina selected RTA, but in general, pattern recognition and determination ofan orientation of a smart device based upon LIDAR data may be much moreefficient, than, for example image data based pattern recognition. Inaddition, the LIDAR based patterns may be formed in a “fingerprint” ofan RTA, wherein it would be very rare, if not impossible to replicatethe LIDAR point patterns at two disparate locations. Therefore,recognition of a point pattern may be used to identity a location of aparticular RTA.

Referring now to FIGS. 15A-B, a flowchart illustrating an exemplaryembodiment of a method of tracking the safety of an area is shown. Atstep 1501, an agent-supported transceiver may be supported by a firstperson. The agent-supported transceiver maybe operative to wirelesslycommunicate with one or more reference point transceivers. This wirelesscommunication may be made by burst transmission, such as byultra-wideband. As discussed above, ultra-wideband communications maydetermine a distance or engage in other communications with thereference point transceivers by using time-delayed signals or otherburst impulses. The wireless communication may also be made by otherprotocols, such as Bluetooth, including Bluetooth 5.1, or otherprotocols enabling measurements from an antenna array associated withthe transceiver, such as AoD or AoA.

At step 1502, a sensor may be movably supported by the first person. Thesensor may move with the person as the person (or a portion thereof)moves. Accordingly, the sensor may change physical location as a portionof the person changes physical location. For example, if theagent-supported transceiver is a smart watch or other device worn by thefirst person, the agent-supported transceiver would move through a room(or other physical location) as the first person does. The sensor may beany of the sensors discussed herein, including any of the physiologicalsensors that may be appropriate to measure a physical characteristic ofthe first person, such as the first person's temperature or heart rate.In exemplary embodiments, the sensor may be in logical communicationwith the agent-supported transceiver.

In some embodiments, a person may be provided with a wearable item withsensors operative to quantify a physiological state in the person at atime period, such as three or seven days prior to an event. An event mayinclude, for example, coming into contact with other persons, such asfor a doctor's appoint, business meeting, sporting event, social eventand the like. In this manner as the person appears at a venue for theevent, accumulated data of the physiological state of the person may beanalyzed and the person be granted access to the event, or directed toanother destination, such as a location for further evaluation.

At step 1503, a condition present in the area may be quantified with thesensor as digital content. The condition may include a physiologicalstate of the first person, such as temperature or heart rate, and mayinclude a physical state of the environment accessible to the sensor. Insome embodiments, this may help control for a physiological state of theperson that is caused in part by an environmental state. For example, asensor that only detects the temperature of the first person may read anelevated temperature of the first person as a fever. However, if thesensor also detects that the environmental temperature is 120° F., thenthe first person and/or sensor may simply be hot. In addition, thecondition may be associated with a recorded time indicating a time ofquantifying the condition.

At step 1504, the digital content quantifying the condition present inthe area may be transmitted by the transceiver to an appropriaterecipient of the condition. For example, the appropriate recipient maybe a controller (including a controller on the agent-supportedtransceiver). The appropriate recipient may be a smart device. Inexemplary embodiments, the transmission by the agent-supportedtransceiver to the smart device may be made via a low-power, wirelesscommunications protocol, such as Zigby, ANT, Bluetooth Low Energy (orBluetooth 5.1), near-field communications, or ultra-wideband.Additionally, the appropriate recipient may be a reference pointtransceiver. In this case, the transmission may be effected byultra-wideband (or similar burst transmission protocols) or byBluetooth, including Bluetooth 5.1.

At step 1505, a digital value may be wirelessly communicated between theagent-supported transceiver and the reference point transceiver. Thisdigital value may be any appropriate value used to calculate a distancebetween the reference point transceiver and the agent-supportedtransceiver. The digital value may be sensor data or it may be timingdata, such as RTT or TDOA. The digital value may relate to an angle ofarrival or an angle of departure of the signal (or other means oftransmitting the digital value). Where the transmission is made by bursttransmission, such as ultra-wideband, the digital value may relate to atime of flight communication, such as TDOA or TDE. A second timeindicator may be generated corresponding to the time at which thedigital value was wirelessly communicated. This time indicator may beabsolute (e.g., the communication occurred at 11:16:01.123456 on Jul.21, 2020) or relative (e.g., the communication occurred 1.123456 secondsafter the first time indicator). In some embodiments, a sensor or othercontroller may be precise enough to record into a data structure timeindicators on the order of picoseconds or nanoseconds. This may bedesirable for burst transmission protocols such as ultra-wideband, whichmay require such precise time measurements.

At step 1506, a positional coordinate of the first person may begenerated based upon wireless communications, as described herein and inthe patents and patent applications incorporated herein by reference.The positional coordinate may be in any desirable coordinate scheme. Thecoordinate scheme may be chosen based on the types and modalities of thesignals transmitted. For example, where angles of arrival and departureare used, polar coordinates, such as cylindrical or sphericalcoordinates, may be desirable. In other embodiments, Cartesiancoordinates may be desirable.

At step 1507, the second time indicator may be associated with thepositional coordinate. This association may take place in a controller,on the agent-supported transceiver, or elsewhere.

At step 1508, a user interface may be generated. The user interface maycomprise a physical position of the first person (comprising thephysical coordinate in the coordinate scheme). The user interface mayalso comprise the quantified condition present in the area. In exemplaryembodiments, a maximum time delta tolerance may be imposed between thewireless communication and the position quantification to ensure thatdata monitored through the interface is relatively current.

In some embodiments, the user interface may include a floorplan or othercontext for positions occupied by a person. For example, if a persontests positive for a contagion, it may be important to ascertain wherethe person has travelled during a preceding time period, such as, forexample ten day, or three days. The present invention may provide aninterface including a floor plan and a path traversed by the person.Some embodiments may include lag times at locations and/or during whichthe person was within a threshold distance to another person.

At step 1509, steps 1501-1508 may be repeated for a second person.Accordingly, a positional coordinate may be generated for the secondperson, along with, in some embodiments, a second quantified condition.

At step 1510, a distance between the first and second person may becomputed. This distance may be computed in a variety of ways. In a firstaspect, by virtue of the determination of positional coordinatesassociated with the first and second person, standard metrics may beused to determine the distance between the first and second person inthe chosen coordinate scheme. For example, if the chosen coordinatescheme is Cartesian coordinates, the position of the first person may beexpressed as (x₁, y₁, z₁) and the position of the second person may beexpressed as (x₂, y₂, z₂). Then the distance between the first andsecond person is given as √{square root over( )}((x₁−x₂)²+(y₁−y₂)²+(z₁−z₂)²). Similarly, if the chosen coordinatescheme is spherical polar coordinates, the position of the first personmay be expressed by radial, polar, and azimuthal coordinates (r₁, θ₁,φ₁) and the position of the second person may be expressed as (r₂, θ₂,φ₂). Then the distance between the first and second person is given as√{square root over ( )}(r₁ ²+r₂ ²−2r₁r₂ [sin θ₁ sin θ₂ cos(ϕ₁−ϕ₂)+cos θ₁cos θ₂]).

In a second aspect, the distance may be computed directly bytransmission between the agent-supported transceivers supported by thefirst and second person. Like the computation of the distance betweenthe first agent-supported transceiver and any of the reference pointtransceivers, this may proceed by direct communication between thetransceivers via Bluetooth or ultra-wideband transmission. Using theTDOA or TDE techniques explored herein, the distance between the firstand second person may be computed. This may be desirable where the firstand second person are within a line-of-sight of each other or areotherwise sufficiently proximate to allow a sufficiently reliable andmeasurable transmission to occur between them.

This distance may be associated with a time indicator (including thetime indicators generated at step 1503 and its repeated version at step1509) and be updated periodically or based on the occurrence of anevent. In some embodiments, this distance may be computed based on lessthan all three dimensions included in the positional coordinates. Forexample, if the first and second person are on separate floors of astructure, then a significant difference in an altitude coordinate maybe given more or less weight.

At step 1511, a minimum distance between the first and second person isdetermined. This minimum may be based on the time at which the distancecomputed at step 1510 was minimized. In some embodiments, a thresholddistance may be assessed, with an alert state triggered if the minimumdistance falls below this threshold distance.

For example, if a safety factor to be monitored relates to thetransmission of communicable disease, then the threshold distance mayrelate to authoritatively promulgated recommended distances (forexample, the Center for Disease Control recommends that people remainsix feet apart to minimize the transmission of COVID-19; in this case,the threshold distance may be six feet). If the first and second personhave a minimum distance below the threshold distance, then the timeduring which the first and second person were beneath the thresholddistance and the conditions present in the area at those times may berecorded and transmitted to a controller.

At step 1512, a user interface indicating respective positions of thefirst and second person may be generated. The user interface may displaythe positions in one or more coordinate systems. The user interface mayalso integrate external data, such as information fed into a controllerby an Augmented Virtual Model. In exemplary embodiments, the userinterface may also display occlusions, such as walls or otherstructures. These occlusions may be based on a scan of the area or anAugmented Virtual Model. The scan may proceed by LIDAR or any of theother methods described herein (and in the patents and patentapplications incorporated herein by reference).

This user interface may be displayed in a variety of ways. For example,the user interface may be an augmented reality interface viewablethrough a smart device, headgear, or other visual means associated withone or more of the agent-supported transceivers. As another example, theuser interface may merely be presented as a graph on a display that maybe viewable by one or more persons.

At step 1513, the user interface (or a second user interface) may beaugmented with conditions present in the area. These conditions may bebased on the sensors associated with the agent-supported transceiverssupported by the first and second persons or may be based on additionalsensors place in the area. These sensors may transmit data to acontroller, which may compile the information from which to generate theuser interface.

At step 1514, conditions conducive to a safety risk may be designated.Such conditions may include any conditions that pose a deleterious riskof impairing any aspect of a person's or a structure's health, safety,or welfare. For example, the safety risk may include physiologicalfactors indicating an illness (especially from a communicable disease)or potential danger (such as an elevated heart rate), environmentalfactors indicating danger (such as an excessively high temperature thatmay indicate a fire or barometric pressure readings indicating severeweather), excessively loud noise, or other factors.

At step 1515, based on the designated conditions conducive to a safetyrisk, a minimum distance associated with the condition may bedetermined. For example, if the safety risk relates to the contractionof an illness borne from a communicable disease, the minimum distancemay be based on a recommended safety distance based on the transmissionvector of the disease. (For example, the Center for Disease Controlrecommends that people stay six feet apart to avoid contractingCOVID-19. Accordingly, if the safety risk relates to the contraction ofCOVID-19, then the minimum distance may be six feet.)

Similarly, if the safety risk relates to environmental factors such asfire, then the minimum distance may be absolute (e.g., 20 feet away froma sensor showing a drastic temperature spike) or relative (e.g. thedistance is a function of the temperature, which allows for anapproximation of the location of the fire).

At step 1516, an alert state may be triggered if conditions or distancesconducive to a safety risk are present, as determined at steps 1514 and1515. The alert state may be transmitted by a transceiver (which may bein logical connection with a controller) to a smart device of a userand/or one or more of the agent-supported transceivers, which are borneby the first and second persons. The alert state may also activate asignaling device, such as an alarm or a light proximate to the first andsecond person.

The alert state may be indicated in the user interface, such as in anaugmented reality interface. This may be achieved by an icon (such as a! icon), flashing message, or any other suitable attention-grabbingmeans. The alert state may also be transmitted in any other suitable wayto alert the first or second person to a condition conducive to a safetyrisk that is affecting the first or second person.

At step 1517, an augmented reality interface of a subset of the areaoccupied by the first or second person may be designated by a positionand a direction of a user-supported smart device (or similaragent-supported transceiver). This subset may indicate a location orother identifier of the first or second person, along with a condition(if present) in the area. This condition may include a physiologicalstate of the first or second person or an environmental state of thesubset of the area. Based on the determined conditions constituting asafety risk above, the augmented reality interface may indicate of thecondition detected in the area constitutes a safety risk. For example,if the condition relates to a measured temperature of the first personindicating a fever, then the augmented reality interface may inform thesecond person (or a third agent in communication with the second person)of the safety risk caused by the first person's fever.

Referring now to FIG. 16, a block diagram illustrates components thatmay be included in various embodiments of a wearable item 1600 with oneor more sensors 1605-1610 and transceivers 1603-1604. the presentinvention. The wearable item 1600 may include a controller 1601, inlogical communication with the other components (e.g. 1601-1617) suchthat the controller 1601 is operative via execution of executablesoftware to perform those method steps described herein and ascribed toa wearable item.

The wearable item will include one or more transceivers 1603-1603 whichmay be a same of different modality and may include a single antenna oran array(s) of antennas. The transceivers 1603-1604 may be controlled bya modality specific module 1602, such as a UWB module, a BLE module, ANTmodule, NFC module, cellular communications module and the like.

Sensors may include for example one or more of: an accelerometer (e.g. a3 axis accelerometer) 1605; a skin temperature sensor 1606, which may bepositioned to come into contact with the skin of a person wearing thewearable item 1600 or have non-contact access to skin surface for IR orsimilar sensors; a pulse oximeter sensor 1607; environmental temperaturesensor 1608; environmental humidity sensor 1609 environments pressuresensor (such as a barometric sensor) 1610; a light sensor 1611; agesture sensor 1612; one or more LEDs 1613, one or more mechanicalswitches 1614; a microphone (e.g. a MEMS microphone) 1615, a vibrator1616 and/or piezo electric device; an audio signal generator 1617 (e.g.a beeper or alarm) and other devices to support the functionality,processes and method steps described herein. For example, power maysupplied via a power source 1618, which may include, by way ofnon-limiting example a LiPo battery.

Components may be contained in and protected by packaging 1618, whichmay be incorporated into a specific type and style of wearable item.

Glossary

“Agent” as used herein refers to a person or automation capable ofsupporting a Smart Device at a geospatial location relative to a GroundPlane.

“Augmented Virtual Model” (sometimes referred to herein as “AVM”): asused herein is a digital representation of a real property parcelincluding one or more three-dimensional representations of physicalstructures suitable for use and As Built data captured descriptive ofthe real property parcel. An Augmented Virtual Model includes As BuiltFeatures of the structure and may include improvements and featurescontained within a Processing Facility.

“Bluetooth” as used herein means the Wireless Personal AreaNetwork(WPAN) standards managed and maintained by Bluetooth SIG. Unlessotherwise specifically limited to a subset of all Bluetooth standards,the Bluetooth will encompass all Bluetooth standards (e.g. Bluetooth4.0; 5.0; 5.1 and BLE versions).

“Digital Content” as used herein refers to any artifact that may bequantified in digital form, By way of non-limiting example, digitalcontent may include, one or more of: alphanumeric text; audio files;image data; video data; digital stories and media.

“Energy-Receiving Sensor” as used herein refers to a device capable ofreceiving energy from a Radio Target Area and quantifying the receivedenergy as a digital value.

“Ground Plane” as used herein refers to horizontal plane from which adirection of interest may be projected.

“Image Capture Device” or “Scanner” as used herein refers to apparatusfor capturing digital or analog image data, an Image capture device maybe one or both of: a two-dimensional sensor (sometimes referred to as“2D”) or a three-dimensional sensor (sometimes referred to as “3D”). Insome examples an Image Capture Device includes a charge-coupled device(“CCD”) sensor. “Intelligent Automation” as used herein refers to alogical processing by a device, system, machine or equipment item (suchas data gathering, analysis, artificial intelligence, and functionaloperation) and communication capabilities.

“Multimodal” as used herein refers to the ability of a device tocommunication using multiple protocols and/or bandwidths. Examples ofmultimodal may include being capable of communication using two to moreof: Ultra-Wideband, Bluetooth; Bluetooth Low Energy; Wi-Fi; Wi-Fi RT;GPS; ultrasonic; infrared protocols and/or mediums.

“Node” as used herein means a device including at least a processor, adigital storage and a wireless transceiver.

“Physical Tag” as used here shall mean a physical device with atransceiver capable of wireless communication sufficient to determine ageospatial position of the device. The Physical Tag may also beassociated with a data set that is not contingent upon the geospatiallocation of the physical device.

“Radio Target Area” an area from which an energy-receiving Sensor willreceive energy of a type and bandwidth that may be quantified by theenergy-receiving Sensor.

“Ray” as used herein refers to a straight line including a startingpoint and extending indefinitely in a direction.

“Sensor” as used herein refers to one or more of a solid state,electro-mechanical, and mechanical device capable of transducing aphysical condition or property into an analogue or digitalrepresentation and/or metric.

“Smart Device” as used herein includes an electronic device including,or in logical communication with, a processor and digital storage andcapable of executing logical commands.

“Smart Receptacle” as used herein includes a case or other receiver of asmart device with components capable of receiving wireless transmissionsfrom multiple wireless positional reference transceivers. In someembodiments, the smart receptacle will include a wireless transmitterand/or a physical connector for creating an electrical path for carryingone or both of electrical power and logic signals between an associatedSmart Device and the Smart Receptacle.

“Structure” as used herein refers to a manmade assembly of partsconnected in an ordered way. Examples of a Structure in this disclosureinclude a building; a sub-assembly of a building; a bridge, a roadway, atrain track, a train trestle, an aqueduct; a tunnel a dam, and aretainer berm.

“Tag” as used herein refers to digital content and access rightsassociated with a geospatial position

“Transceive” as used herein refers to an act of transmitting andreceiving data.

“Transceiver” as used herein refers to an electronic device capable ofone or both of wirelessly transmitting and receiving data.

“Vector” as used herein refers to a magnitude and a direction as may berepresented and/or modeled by a directed line segment with a length thatrepresents the magnitude and an orientation in space that represents thedirection.

“Virtual Tag” as used here shall mean digital content associated with alocation identified via positional coordinates.

“Wearable” as used herein means capable of being removably positioned ona human being such that an item that is worn by a person is supported bythe person; and moves about with the person, as an area of the person onwhich the item being worn moves about. For example, a wearable item thatcomprises a wrist band may be positioned on a wrist of a person and willmove with the person's wrist as the wrist moves. Movement of the wristmay be accomplished as the person walks and/or as the person's arm ismoved relative to the person's body. Similarly, a wearable item thatcomprises headgear will move as the person walks and/or as the personmoves their head.

“Wireless Communication Area” (sometimes referred to as “WCA”) as usedherein means an area through which wireless communication may becompleted. A size of a WCA may be dependent upon a specified modality ofwireless communication and an environment through which the wirelesscommunication takes place. In discussion (and as illustrated), a WCA maybe portrayed as being spherical in shape, however in a physicalenvironment a shape of a WCA may be amorphous or of changing shape andmore resemble a cloud of thinning density around the edges.

Data analysis techniques, such as a Fast Fourier Transform; structuredqueries; and unstructured queries may yield relevant patterninformation.

A number of embodiments of the present disclosure have been described.While this specification contains many specific implementation details,there should not be construed as limitations on the scope of anydisclosures or of what may be claimed, but rather as descriptions offeatures specific to particular embodiments of the present disclosure.While embodiments of the present disclosure are described herein by wayof example using several illustrative drawings, those skilled in the artwill recognize the present disclosure is not limited to the embodimentsor drawings described. It should be understood the drawings and thedetailed description thereto are not intended to limit the presentdisclosure to the form disclosed, but to the contrary, the presentdisclosure is to cover all modification, equivalents and alternativesfalling within the spirit and scope of embodiments of the presentdisclosure as defined by the appended claims.

The headings used herein are for organizational purposes only and arenot meant to be used to limit the scope of the description or theclaims. As used throughout this application, the word “may” is used in apermissive sense (i.e., meaning having the potential to), rather thanthe mandatory sense (i.e., meaning must). Similarly, the words“include”, “including”, and “includes” mean including but not limitedto. To facilitate understanding, like reference numerals have been used,where possible, to designate like elements common to the figures.

The phrases “at least one”, “one or more”, and “and/or” are open-endedexpressions that are both conjunctive and disjunctive in operation. Forexample, each of the expressions “at least one of A, B and C”, “at leastone of A, B, or C”, “one or more of A, B, and C”, “one or more of A, B,or C” and “A, B, and/or C” means A alone, B alone, C alone, A and Btogether, A and C together, B and C together, or A, B and C together.

The term “a” or “an” entity refers to one or more of that entity. Assuch, the terms “a” (or “an”), “one or more” and “at least one” can beused interchangeably herein. It is also to be noted the terms“comprising”, “including”, and “having” can be used interchangeably.

Certain features that are described in this specification in the contextof separate embodiments can also be implemented in combination in asingle embodiment. Conversely, various features that are described inthe context of a single embodiment can also be implemented incombination in multiple embodiments separately or in any suitablesub-combination. Moreover, although features may be described above asacting in certain combinations and even initially claimed as such, oneor more features from a claimed combination can in some cases be excisedfrom the combination, and the claimed combination may be directed to asub-combination or variation of a sub-combination.

Similarly, while method steps may be depicted in the drawings in aparticular order, this should not be understood as requiring that suchoperations be performed in the particular order shown or in a sequentialorder, or that all illustrated operations be performed, to achievedesirable results.

Certain features that are described in this specification in the contextof separate embodiments can also be implemented in combination in asingle embodiment. Conversely, various features that are described inthe context of a single embodiment can also be implemented incombination in multiple embodiments separately or in any suitablesub-combination. Moreover, although features may be described above asacting in certain combinations and even initially claimed as such, oneor more features from a claimed combination can in some cases be excisedfrom the combination, and the claimed combination may be directed to asub-combination or variation of a sub-combination.

Moreover, the separation of various system components in the embodimentsdescribed above should not be understood as requiring such separation inall embodiments, and it should be understood that the described programcomponents and systems can generally be integrated together in a singlesoftware product or packaged into multiple software products.

Thus, particular embodiments of the subject matter have been described.Other embodiments are within the scope of the following claims. In somecases, the actions recited in the claims can be performed in a differentorder and still achieve desirable results. In addition, the processesdepicted in the accompanying figures do not necessarily require theparticular order show, or sequential order, to achieve desirableresults. In certain implementations, multitasking and parallelprocessing may be advantageous. Nevertheless, it will be understood thatvarious modifications may be made without departing from the spirit andscope of the claimed disclosure.

What is claimed is:
 1. An apparatus, supportable by a first person, fortracking safety conditions in an area, the apparatus comprising: acontroller comprising a processor and a digital storage, said controllerin logical communication with a user interface display; a firstagent-supported transceiver movably supportable by an agent located at afirst geospatial position, which first agent-supported transceiver is inlogical communication with the controller and operative to transmit orreceive data from a reference point transceiver; a wirelesscommunication device in logical communication with the controller;executable code stored on the digital storage and executable by theprocessor to cause the controller to: a. receive from a first sensormovably supported by the first person a quantification of a conditionpresent in the area with the first sensor, wherein the quantification isdigital content, and associate a first time indicator with thecondition; b. transmit a wireless communication via the wirelesscommunication device to a receiver the digital content quantifying thecondition present in the area with the agent-supported transceiver; c.wirelessly communicate between the first agent-supported transceiver anda reference point transceiver a digital value to calculate a distancebetween the first agent-supported transceiver and the reference pointtransceiver; d. generate a positional coordinate of the first personbased upon the wireless communication; e. associate a second timeindicator with the positional coordinate and the time at which thewireless communication occurred; f. generate a display on the userinterface comprising a physical position of the first person and thequantified condition present in the area; g. update the user interfaceto indicate conditions present in the area and respective positions ofpersons at specified times; h. designate one or more conditionsconducive to a safety risk; and i. based upon a condition conducive to asafety risk, trigger an alarm state.
 2. The apparatus of claim 1,wherein the executable code is further operative to cause the controllerto: m. receive from a second agent-supported transceiver supported by asecond person a positional coordinate corresponding to a location of thesecond person; n. calculate a distance between the first person and thesecond person at one or more time instances; o. determine a minimumdistance between the first person and the second person; and p. updatethe user interface to indicate respective positions of the first personand the second person.
 3. The apparatus of claim 2, wherein theexecutable code is further operative to cause the controller to: q.associate one or more threshold minimum distances with the one or moreconditions conducive to a safety risk; and r. based upon a conditionconducive to a safety risk or a minimum distance between the first andsecond person being lower than a threshold minimum distance associatedwith a condition conducive to a safety risk, trigger an alarm state. 4.The apparatus of claim 1, wherein the first agent-supported transceiveris capable of transmitting and receiving via a burst transmissionprotocol.
 5. The apparatus of claim 4, wherein the burst transmissionprotocol comprises ultra-wideband.
 6. The apparatus of claim 1, whereinthe first agent-supported transceiver is capable of transmitting andreceiving via Bluetooth.
 7. The apparatus of claim 1, wherein the firstagent-supported transceiver is in logical communication with a smartdevice.
 8. The apparatus of claim 7, wherein the first agent-supportedtransceiver is capable of transmitting and receiving via a low-powerwireless communication protocol.
 9. The apparatus of claim 8, whereinthe low-power wireless communication protocol comprises Bluetooth LowEnergy.
 10. The apparatus of claim 8, wherein the low-power wirelesscommunication protocol comprises near field communications.
 11. Theapparatus of claim 10, wherein the first agent-supported transceiver iscapable of transmitting and receiving via ultra-wideband.
 12. Theapparatus of claim 1, wherein the positional coordinate comprises aCartesian coordinate.
 13. The apparatus of claim 1, wherein thepositional coordinate comprises a cylindrical polar coordinate.
 14. Theapparatus of claim 1, wherein the positional coordinate comprises aspherical polar coordinate.
 15. The apparatus of claim 1, wherein thealarm state comprises activating a signaling device.
 16. The apparatusof claim 1, wherein the executable code is further operative to, basedupon the triggering of the alarm state, cause the first agent-supportedtransceiver to transmit a signal to a smart device.
 17. The apparatus ofclaim 1, wherein the executable code is further operative to, based uponthe triggering of the alarm state, cause the user interface to displayan indicator.
 18. The apparatus of claim 1, wherein the executable codeis further operative to, based upon the triggering of the alarm state,cause the first agent-supported transceiver to transmit a notificationto one or both of: the first and a second person.
 19. The apparatus ofclaim 1, wherein the executable code is further operative to cause thecontroller to generate an augmented reality interface of a subset of thearea based on the position and direction of orientation of anagent-supported smart device.
 20. The apparatus of claim 19, wherein theaugmented reality interface further comprises an identifier associatedwith one or both of the first and a second person.
 21. The apparatus ofclaim 20, wherein the augmented reality interface further comprises anindication of a condition associated with one or both of the first andsecond person.
 22. The apparatus of claim 21, wherein the conditioncomprises the condition conducive to a safety risk.
 23. The apparatus ofclaim 1, wherein the sensor comprises a thermoelectric device, and thecondition comprises a body temperature exceeding a specified value. 24.The apparatus of claim 1, wherein the sensor comprises a heartratemonitor, and the condition comprises an elevated heartbeat.
 25. Theapparatus claim 2, wherein the minimum distance is six feet.